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INTRODUCTION 

The VAX/VMS Operating System Internals course is intended for 
the student who requires an extensive understanding of the 
components, structures, and mechanisms contained in the VAX/VMS 
operating system. It is also an aid for the student who will go 
on to examine and analyze VAX/VMS source code. 

This course provides a discussion of the interrelationships 
among the logic or code, the system data structures, and the 
communication/synchronization techniques used in major sections of 
the operating system. 

Technical background for selected system management and 
application programmer topics is also provided. Examples of this 
information include: 

• The implications of altering selected system parameter 
("tuning" or "SYSGEN" parameter) values 

• The implications of granting privileges, quotas, and 
priorities 

• How selected system services perform requested actions. 

Information is provided to assist in subsequent 
system-related activities such as: 

• Writing privileged utilities or programs that access 
protected data structures 

• Using system tools (e.g., the system map, the system dump 
analyzer, and the MONITOR program) to examine a running 
system or a system crash. 

This course concentrates on the software components included 
in (and the data structures defined by) the linked system image. 
Associated system processes, utilities, and other programs are 
discussed in much less detail. Specifically, the implementation 
of I/O and the method of writing a device driver for VAX/VMS are 
not discussed in this course. 
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COURSE GOALS 

1. Describe the contents, use, and interrelationship of 
selected VAX/VMS components (e.g., job controller, 
ancillary control processes, and symbionts), data 
structures (e.g., SCB, PCB, JIB, PHD, and PI space), and 
mechanisms (e.g., synchronization techniques, change mode 
dispatching, exceptions and interrupts.) 

2. Describe the similarities and differences of system 
context and process context. 

3. Discuss programming considerations and system management 
alternatives in such problems as: 

- assigning priorities in a multi-process application, 

controlling paging and swapping behavior for a process 
or an entire system, and 

- writing and installing a site-specific system service. 

4. Use system-supplied debugging tools and utilities (e.g., 
SDA and XDELTA) to examine crash dumps and to observe a 
running system. 

5. Describe the data structures and software components used 
when a process is created or deleted, an image is 
activated and terminated, and the operating system is 
initialized. 

6. Describe how the following interrupt service routines are 
implemented : 

- AST delivery 

- Scheduling 

- Hardware clock 
Software timers 
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RESOURCES 

1. VAX/VMS Internals and Data Structures Manuals 

2. VAX/VMS System Dump Analyzer Reference Manual 

3. VAX/VMS Operating System Internals Supplemental Listings 
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COURSE OUTLINE 

I. System Components 

A. How VMS implements the functions of an operating system 

B. How, and when, operating system code is invoked 

C. Interrupts and priority levels 

D. Location of code and data in virtual address space 

E. Examples of flows for: 

1. Hardware clock interrupt 

2. System event completion 

3. Page fault 

4. RMS request for I/O 
5- $QIO request for I/O 
6. DECNET communication 

F. Examples of System processes 

1. Operator communication (OPCOM) 

2. Error logger (ERRFMT) 

3. Job controller (JOB_CONTROL) 

4. Symbionts (PRTSYMBn) 

II. The Process 

A. Overview - process data structures 

1. Software context information 

2. Hardware context information 

B. Overview - virtual address space 

1. S0 space (operating system code and data) 

2. P0 space (user image code and data) 

3. PI space (command language interpreter, process data) 
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III. System Mechanisms 

A. Processor and process state 

B. Interrupts 

C. Access modes and exceptions 

D. Synchronization 
IV. Debugging Tools 

A. Crash dumps and bugchecks 

B. The system map file (SYS. MAP) 

C. The system dump analyzer (SDA) 

D. Other debugging tools (DELTA, XDELTA, CCL r PATCH) 
V. Scheduling 

A. Process states 

1. What they are (current, computable, wait) 

2. How defined 

3. How they are related 

B. How process states are implemented in data structures 

1. Queues 

2. Process data structures 

C. Operating system code that implements process state 
changes 

1. Context switch (SCHED.MAR) 

2. Result of system event (RSE.MAR) 

D. Steps at quantum end 

1. Automatic working set adjustment 

E. Boosting software priority of normal processes 
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VI. Paging 

A. Linker action in creating executable files 

B. Image activator for setting up process header 

C. Invoking pager routine 

D. Memory management data structures 

E. Following a process page faulted in and out of a process 

F. Following a global page faulted in and out of a process 

VII. Swapping 

A. Comparison of paging and swapping 

B. Swapper functions 

1. Maintain free page count 

• Write modified pages to paging file 

• Shrink working sets 

2. Outswap - rules and example 

3. Inswap - rules and example 

C. Selected events that wake swapper 

D. Locating disk files for swap 

E. How swapper's P0 page table is used to speed disk I/O 
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VIII. Process Creation and Deletion 

A. Process creation and deletion 

1. Roles of operating system programs 

2. Creation of process data structures 

3. Deletion sequence 

B. Initiating jobs 

1. Interactive 

2. Batch 

C. DCL structure and function 

D. Image activation and rundown 

1. Mapping image file 

2. Image startup 

3. Termination handlers 

IX. System Initialization and Shutdown 

A. System initialization sequence 

B. Functions of initialization programs 
C How memory is structured and loaded 

D. Startup command procedures 

E. Hardware differences in the 780, 750, and 730 and how they 
affect initialization 

F. Front panel switches 

G. Shutdown procedures and their functions 
H. Auto-restart sequence 

I. Power-fail recovery 
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SYSTEM COMPONENTS 



INTRODUCTION 

This module introduces the major software components supplied 
in or with the VAX/VMS operating system. As an overview of the 
operating structure, it gives a review of facilities introduced in 
previous VAX/VMS courses. New terms and logic components are 
introduced, but detailed discussion of them is generally deferred 
until later modules of this course. 

This module does not provide a complete catalog of all 
facilities, modules, and programs in the operating system. It 
provides an understanding of the relationships and coordination 
among the various software components. 

Software components may be classified by several attributes, 
including : 

• Implementation form (service routine, procedure, image, or 
process) 

• "Closeness" to the linked system image (part of SYS. EXE, 
linked with system symbol table, privileged known image, 
and so forth) 

• Access mode (kernel, executive, supervisor, or user) 

• Address region (program, control or system) 

• Memory residence characteristics (can be paged, swapped or 
shared) . 
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OBJECTIVES 

Upon completion of this module, for each selected VAX/VMS 
software component, you will be able to briefly describe: 

1. Its primary function 

2. Its implementation (process, service routine, or 
procedure; in which address region it resides; what 
access modes it uses) 

3. The method or methods by which it accomplishes 
communication . 



RESOURCES 

Reading 

• VAX/VMS Internals and Data Structures Manual , overview 

Additional Suggested Reading 

• VAX/VMS Internals and Data Structures Manual , Chapters on 
I/O System Services, interactive and batch jobs, and 
miscellaneous system services. 

Source Modules 

Facility Name 

SYS 

DCL,MCR,CLIUTL 

RSX 

DEBUG 

RTL 

RMS 

F11A,F11B,MTAACP 

REM,NETACP 

JOBCTL , INPSMB , PRTSMB 

OPCOM 

ERRFMT 
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TOPICS 

I. How VMS Implements the Functions of an Operating System 
II. How, and When, Operating System Code Is Invoked 
III. Interrupts and Priority Levels 
IV. Location of Code and Data in Virtual Address Space 

V. Examples of Flows for: 

A. Hardware clock interrupt 

B. System event completion 

C. Page fault 

D. RMS request for I/O 

E. $QIO request for I/O 

F. DECNET communication 
VI. Examples of System Processes 

A. Operator Communication (OPCOM) 

B. Error logger (ERRFMT) 

C. Job controller (JOB_CONTROL) 

D. Symbionts (PRTSYMBn) 
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THREE MAIN PARTS OF VMS 

Scheduling and Process Control (iPl- *v 

Functions 

• Assign processor to computable process with highest 
priority 

• Attend to process state transitions 

• Facilitate synchronization of processes 

• Perform checks and actions at timed intervals 

Code and Data 

• Scheduler interrupt service routine 

• Report system event code 

• Hardware clock and software timer interrupt service 
routines 

• System services ($WAKE) 

Memory Management 

Functions 

• Translate virtual addresses to physical addresses 

• Distribute physical memory among processes 

• Protect process information from unauthorized access 

• Allow selective sharing of information between processes 

Code and Data 

• Pager fault service routine and swapper process 

• PFN database, page tables 

• System services ($CRETVA) 

I/O Subsystem 

Functions 

• Read/write devices on behalf of software requests 

• Service interrupts from devices 

• Log errors and device timeouts 

Code and Data 

• Device drivers, device independent routines 

• I/O data structures 

• System Services ($QIO) 
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INVOKING SYSTEM CODE 



EVENT 



PAGE 
FAULT 



INTERRUPT 



TABLE 






POINTER TO 

PAGE FAULT 

CODE 



POINTER TO 

SCHEDULER 

CODE 






EXECUTED CODE 



$ 



v s 



<F*& 



PAGE 
FAULT 
CODE 



I scheduler! 

CODE 



Figure 1-1 Invoking System Code 



VAX/VMS driven by interrupts and exceptions 

On interrupt or exception, hardware vectors to correct 
code 

Example, page fault 

Page fault occurs 
Hardware vectors through table 
- Page fault code executes 
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HARDWARE MAINTAINED PRIORITY LEVELS 



• Processor is always operating at one of 32 possible 
hardware maintained priority levels (0 - 31). 



•X* 



Operating at a higher level causes hardware to block 
interrupts at the same and lower levels from being 
serviced . 

Hardware determines which code will execute after an 
interrupt occurs. 

How to get into and out of different levels: 

1. Interrupt 

Into - Hardware requests interrupt (for example, 
from a terminal). Levels 16 through 31. 
Software requests interrupt (uses MTPR 
instruction). Levels through 15. 

/ 
ptf ""Out of - Use REI instruction. 

2. Block Interrupt 

Into - Software raises priority level (uses MTPR) 
Out of - Software lowers priority level (uses MTPR) 

These hardware maintained priority levels are called 
Interrupt Priority Levels (IPLs). 
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INTERRUPT SERVICING SEQUENCE 




User program being executed. 

PC = address of next 
instruction to be executed. 



PSL = general 
information . 



status 



IPL 



PSL 



Interrupt occurs. Associated 
IPL must be greater than 
current IPL in PSL, else 
interrupt not serviced. 



PC 



PSL 



Hardware saves current PC and 
PSL oh stack. 




Hardware indexes into table of 
service routine addresses to 
get new PC, and builds new PSL. 



NEW PC 



SYSTEM CONTROL BLOCK 



TK-8949 



Figure 1-2 Example of Interrupt Servicing 
(Sheet 1 of 2) 
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Interrupt service 
executes at new IPL. 



routine 



At end, interrupt dismissed 
with REI istruction (making 
sure old PC and PSL are at top 



INTERRUPT SERVICE of stack ) 
ROUTINE 




TK-8948 



REI 

Pops PC, PSL from stack 

- Checks PSL 

- Moves PC, PSL to CPU 
registers 

Transfers control to PC 

Interrupted program continues 
execution . 



Figure 1-2 Example of Interrupt Servicing 
(Sheet 2 of 2) 
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TWO TYPES OF PRIORITY 



IPL 
31 

I 

16 



requested by 
hardware 



15 



requested by 
software 



Hardware 
Maintained 



Software 
Maintained 



16 



Real time 
process 

10 



15 



Normal 
process 



t^ 



Figure 1-3 Two Types of Priority 
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ACCESS MODES AND COMPONENTS 



Runtime 
Library 



Program 

Development 

Tools 




User 
Images 



KESU 



Figure 1-4 Access Modes and Components 



1. The kernel of the operating system (shown here in the 
innermost circle) is protected from the user by several 
layers of access protection. 

2. The user normally accesses this protected code and data 
through the Command Language Interpreter (CLI) , Record 
Management Services (RMS), and the system services. 

3. System services are routines in the operating system 
kernel which may be called by the user via a well defined 
interface . 
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LOCATION OF CODE AND DATA 



Process A 



PER 
PROCESS — 
ADDRESSES 



NATIVE MODE IMAGE 



RUN-TIME LIBRARY 



DEBUGGER CODE 



Process B 



COMPATIBILITY 
MODE IMAGE 



APPLICATION MIGRATION 
EXECUTIVE (NATIVE) 



PROGRAM REGION (PO) 



COMMAND LANGUAGE 

INTERPRETER 

DATA — SYMBOL TABLE 

CODE 

DEBUGGER DATA — 
SYMBOL TABLE 



COMMAND LANGUAGE 
INTERPRETER 
DATA — SYMBOL TABLE 
CODE 



CONTROL REGION (P1) 



SYSTEM 
ADDRESSES 



I 



SYSTEM SERVICES 



RECORD MANAGEMENT SERVICES 



SYSTEM REGION (SO) 



I 



Figure 1-5 Location of Code and Data in 
Virtual Address Space 



2. 

3. 



Images running within processes use several different 
types of software components. Many of these components 
are shareable sections, shareable images, or system code. 
P0 space (the program region) and PI space (the control 
region) are mapped differently for native and 
compatibility mode images. 

P0 space is where user's code and data are mapped. 

PI space is where process-specific information is stored 
by the operating system. 

S0 space is where the operating system resides. One copy 
of the operating system is shared by all processes. 
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ENTRY PATHS INTO VMS KERNEL 



i 



External Device Xf>L ?0 - 2 & 

Hardware Interrupts 



Translation - not - Valid 

Fault 

(Page Fault) 






Rescheduling 
Software Interrupt 

IPl3 




Device Driver 
Fork Processing 
Software Interrupts 

tpL. it'll 



I/O Postprocessing 
Software Interrupt 



(tttRS^ 



m i 



SO* 



AST Delivery 
Software Interrupt 



Hardware Clock 
Interrupt ^ -a 



Software Timer 
Interrupt £|?L,7 



Figure 1-6 Entry Paths into VMS Kernel 

Memory Management 

• Brings virtual pages into memory 
Process and Time Management 

• Saves and restores context of process 

• Updates system time 

• Checks timer queue entries (TQES) , quantum end 

• Causes events to be processed 

I/O Subsystem 

• Reads/writes device 

• Finishes I/O processing 
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Table 1-1 Summary of System Components and Functions 



Function 



System Component 



Assign CPU to highest priority 
computable process 

Move working set between disk 
and memory 

Move pages from disk to memory 

Update system clock and quantum 
field, check for servicing at 
intervals 

Perform servicing at intervals 

• check for quantum end 

• cause events to be posted 

• check device timeout 

• wake swapper and error logger 

Handle requests to/replies from 
operator 

Write errors to error log file 

Maintain volume structures for 
driver 

Create processes for print jobs, 
batch jobs, interactive jobs 

Control devices, service device 
interrupts, check for and report 
device errors 

Handle printing of files 

Handle process state transitions 
resulting from event completion 



SCHEDULER 



SWAPPER 



PAGER 

HARDWARE CLOCK ISR 

SOFTWARE TIMER ISR 



OPCOM 



ERRFMT 



ANCILLARY CONTROL 
PROCESS 

JOB CONTROLLER 



DRIVERS 

PRINT SYMBIONTS 
REPORT SYSTEM EVENT 
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THREE TYPES OF SYSTEM COMPONENTS 



THREE TYPES OF SYSTEM COMPONENTS 

PROCESSES: 



ACP 



JOB CONTROLLER 



SWAPPER 



ERRFMT 



SYMBIONTS 



OPCOM 



EXCEPTION AND INTERRUPT SERVICE ROUTINES: 



SCHEDULER 



PAGER 



DRIVERS 



HARDWARE CLOCK 



SOFTWARE TIMER 



ROUTINES: 



REPORT SYSTEM EVENT 



SYSTEM SERVICES 



TK-8946 



Figure 1-7 Three Types of System Components 
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HARDWARE CLOCK INTERRUPT 



Process A 



Process C 



Per Process 

Space 
Process 

Context 




System 
Space 

System 
Context 



Figure 1-8 Hardware Clock Interrupt 



Clock 

Updates system time and quantum field 
Checks first timer queue "entry 

O Timer 

- Checks for quantum end 

Causes events to be processed 

Report system event 

Changes process state 

May request scheduler interrupt 

Scheduler 

Current < > Computable 

Swapper 

Inswaps computable process 

Scheduled user program runs 
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PERIODIC CHECK FOR DEVICE TIMEOUT 



Process A 



Process C 



Per Process 
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Context 



System 
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Figure 1-9 Periodic Check for Device Timeout 

6") P'XSC4AJ 



Hardware clock interrupt 



Once every second, a timer queue entry becomes 
causes a system subroutine to execute. 



due which 



This system subroutine checks for device 
drivers to handle timeouts. 



timeouts, calls 
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PERIODIC WAKE OF SWAPPER, ERROR LOGGER 
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Figure 1-10 Periodic Wake of Swapper, Error Logger 
SCHJCHSB 



• The same system subroutine may wake the swapper process 
and the error logger processes. 

• Scheduler interrupt is requested. 

• Swapper and error logger will eventually run. 
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SYSTEM EVENT REPORTING 



Per Process 

Space 
Process 

Context 



Process A 



USER 
I PROGRAM A I 



Process B 



USER 
| PROGRAM B 




Process C 



System 
Space 

Process 
Context 



PAGER 




System 
Space 

System 
Context 



ptf 



TIMER 

I/O COMPLETION 



© 



SET EVENT FLAG 

WAKE 

RESUME 




REPORT 
SYSTEM 
EVENT 



SCHEDULER 

INTERRUPT 

SERVICE 

ROUTINE 



Figure 1-11 System Event Reporting 
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PAGE FAULT 
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Figure 1-12 Page Fault 
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DATA TRANSFER USING RMS 
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Figure 1-13 Data Transfer Using RMS 



When record formats are defined within disk blocks (or 
clusters of blocks) , then the Record Management Services (VAX-11 
RMS) are used. 
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FILE MANIPULATION USING RMS 



Process A 



Process B 



Per Process 

Space 
Process 

Context 




System 
Space 

System 
Context 



Figure 1-14 File Manipulation Using RMS 



When a file structure is imposed on a volume, the following 
operations require the intervention of Ancillary Control Processes 
(ACPs) to interpret or manipulate the file structure. 

• File open 

• File close 

• File delete 

• Window turn (for read or write) 



&*» 
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DATA TRANSFER USING $QIO 
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Figure 1-15 Data Transfer Using $QIO 
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$QIO SEQUENCE OF EVENTS 
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Figure 1-16 $QIO Sequence of Events 



36 



SYSTEM COMPONENTS 



INTRODUCTION TO DECnet 



DECnet Protocols 



+ + 

I DATA | 
+ + 

I DAP | | 



Data in the remote file 



Handled by DAP and FAL for 
data transfer 



|NSP| | | 
+ + + + 



Handled by NETDRIVER and NETACP 
for data transfer via logical 
link 



| TRANS | | | | 
|DDCMP| | | | |CRC| 



Handled by NETDRIVER and NETACP 
to determine routing 

Handled by XMDRIVER and DMC/DMR 
hardware to detect and retransmit 
on-line noise error 



Figure 1-17 DECnet Protocol Layers 
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DECnet REMOTE FILE ACCESS 
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Figure 1-18 DECnet Remote File Access (e.g., Copy) 
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REMOTE FILE ACCESS-DATA FLOW 
Setting Up Logical Link 

On source node 

1. User issues DCL command: 

TYPE NODEB-NAME PASSWORD" :: DISK$ : [DIRECTORY] FILENAME. EXT 

2. RMS detects ::, sets up logical link with process FAL on 

NODEB 

3. RMS issues internal QIO to NETDRIVER. 

4. NETDRIVER passes the I/O request to NETACP, wakes NETACP. 

5. NETACP sets up data structures to support the logical 
link. 

6. NETDRIVER builds packet and issues internal QIO to 
XMDRIVER. 

7. XMDRIVER sends packet via DMC/DMR on physical line. 
On remote node 

1. XMDRIVER receives packet, passes to NETDRIVER. 

2. NETDRIVER passes packet to NETACP; sends Connect 
Acknowledge back to source node. 

3. NETACP sets up data structures, handles process creation 
for FAL. 

Data Transfer Within Logical Link 

1. Logical link has been established to FAL, which issues 
requests to RMS on remote node and sends packets back via 
NETDRIVER. 

2. Protocol headers are added to packet at source and removed 
from packet at remote node. 
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DECnet TASK-TO-TASK COMMUNICATION 
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Figure 1-19 DECnet Task-to-Task Communication 
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TASK-TO-TASK COMMUNICATION DATA FLOW 

1. For example, on the source node, the user issues: 
$DEF XXX NODEB ,,n,, USERID PASSWORD" ""::"" "TASK=YYY" " " 
and in the program: 

OPEN (NAME=XXX ) 

2. The OPEN command will be passed to RMS. 

3. RMS checks the translation and will set up a logical link 
with the remote program YYY. 

4. The procedure is similar to remote file access with the 
following differences: 

a. The command procedure YYY.COM must reside on the 
directory of USERID on NODEB (SYS$L0GIN) . 

b. The remote program will use the logical name SYS$NET 
to accept connection. 

e.g., OPEN (NAME=SYS$NET ) 

c. The two programs must cooperate. For example, when 
one program issues a Read, the other issues a Write. 

5. It is possible for a sophisticated user task to bypass 
RMS, by issuing QIO's directly to the NETDRIVER. 
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DECnet PERFORMING SET HOST OPERATION 
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Figure 1-20 Performing Set Host Operation 
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SET HOST DATA FLOW 

1. Similar to task-to-task communication with the following 
differences : 

a. The user task in source node is RTPAD. When user 
types 'SET HOST' , RTPAD is initiated. 

b. A logical link is set up with REMACP. When the 
connection is established, REMACP creates an RT device 
and initializes it. 

c. The request from the user task on the source node is 
first given to REMACP via logical link. REMACP then 
gives it to RTTDRIVER. RTTDRIVER passes the request 
to VMS as if the request comes from a real terminal. 

d. The output from VMS goes directly from RTTDRIVER to 
NETDRIVER. The information is then transferred via 
the logical link to RTPAD on the source node. 

2. REMACP is started at network startup time. It runs as a 
detached process and can handle more than one logical 
link. Each logical link will be associated with a process 
RTAn where n can go up to 15 by default. 
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DECnet Software Components 

RMS 

• Interprets command; issues internal QIO to NETDRIVER. 
DAP 

• Handles the protocol exchanges for file transfer 
NETDRIVER and NETACP 

• Handle the protocol exchanges for 

NSP (to get to correct task) 
Transport (to get to correct node) 

• NETDRIVER handles the time critical functions (e.g., 
transmit or receiver data) . 

• NETACP handles the non-time critical functions (e.g., 
setting up logical link) . 

XMDRIVER 

• Handles the DMC/DMR hardware which detects line noise 
errors and retransmits. 

FAL 

• Access files on remote system. 
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OPCOM, ERROR LOGGER 
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Figure 1-21 OPCOM, Error Logger 



OPCOM Process 



Handles requests to and responses from the system 
operator . 



Error Logger 



• Has buffers in memory in which detected errors are 
recorded 

• Writes to the error log file. 
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SYSTEM COMPONENTS 



LINE PRINTER 



A. LIS 




Figure 1-22 Print Jobs ^ 
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SYSTEM COMPONENTS 



BATCH JOBS 



$SUBMIT A 
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PROCESS 



T 
± 



A. COM 
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JOB CONTROLLER 






Figure 1-23 Batch Jobs 



BATCH PROCESS 
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SYSTEM COMPONENTS 



TERMINAL INPUT 




Figure 1-24 Terminal Input 
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SYSTEM COMPONENTS 



CARD READER INPUT 




Figure 1-25 Card Reader Input 
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THE PROCESS 



INTRODUCTION 

This module details a familiar part of VAX/VMS: the process. 
The definition of a process is fundamental to understanding the 
operating system. The process is the representation of each user 
of the system. Several of the software components of the system 
itself are also processes. (See the "System Components" module.) 

The process is the basic scheduling entity of VAX/VMS. A 
group of one or more processes forms the basic accounting entity 
of VAX/VMS: the job. Some features and resources are only 
defined for each process, while other resources and features are 
shared among all the processes in a job. Three major classes of 
attributes and resources can define a process and the operations 
performed within it. 

• Hardware process context 

• Software process context 

• Virtual address space (and associated memory management 
data) . 

Hardware context includes the contents of the hardware 
processor registers that contain perprocess values (separate from 
system-wide ones). Examples of these registers include: 

• The general purpose registers (R0 through Rll) 

• The frame pointer (FP) , argument pointer (AP) , the four 
perprocess stack pointers (KSP,ESP,SSP,USP) , and the 
current stack pointer (SP) 

• The processor status longword (PSL) and the program 
counter (PC) 

• Hardware registers that define the state of the AST queue 
and the locations and sizes of the page tables of the 
process . 
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Software context defines the resources and attributes used by 
the VAX/VMS software but not used by the VAX-11 hardware. 
Examples of this type of information include: 

• Resource quotas, privileges, and accumulated accounting 
values 

• Scheduling or software priority 

• Link fields to operating system data structures and queues 

• Identification fields such as username, UIC, process name, 
and process ID. 

Virtual address space includes the mapping information for 
and the contents of the perprocess address regions, the program 
(or P0) region and the control (or PI) region. In addition, all 
processes implicitly share the system region. Software executing 
in any of the three address regions, but using the hardware and 
software context of a process is said to be "executing in the 
context of the process." Software components using only system 
address space and the interrupt stack execute in system context 
(outside process context) . Examples inlcude interrupt service 
routines and device drivers. 



OBJECTIVES 

• Describe the similarities and differences of system 
context and process context. 

• Using the System Dump Analyzer on either a crash dump file 
or the current system, examine and interpret the software 
process control block, process header, job information 
block, and control region of a specified process. 

• Describe how the various process data structures are used, 
which of the structures are modified (and when this 
occurs), and which of the structures may be reset to 
default or initial values (and when this occurs) . 

• Discuss the SYSGEN parameters that relate to process 
characteristics, and the effects of altering those 
parameters. 
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RESOURCES , r 

Reading k^* 



• VAX/VMS Internals and Data Structures Manual , overview, 
chapters on use and listing of map files, and naming 
conventions. ^ 

Additional Suggested Reading ft P 

• VAX/VMS Internals and Data Structures Manual , chapters on 
executive data areas, data structure definitions, and size 
of system virtual address space. 

• VAX/VMS System Dump Analyzer Reference Manual 

Source Modules 

Facility Name Module Name 

SYS SHELL 

SYSIMGACT 

SYSBOOT 

SCHED 

PAGEFAULT 

SWAPPER 

SYS. MAP 
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TOPICS 

I. Overview - Process Data Structures 

A. Software context information 

B. Hardware context information 

II. Overview - Virtual Address Space 

A. S0 space (operating system code and data) 

B. P0 space (user image code and data) 

C. PI space (command language interpreter, process data) 
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PROCESS DATA STRUCTURES OVERVIEW 



S0 SPACE 



/&$<$¥& 







l$$iyS^~~ 




JOB 

INFORMATION 

BLOCK 

(JIB) 



SOFTWARE 

PROCESS 

CONTROL 

BLOCK 

(PCB) 



AhM*> 



Z/ 



PO PAGE 
TABLE 



t 



P1 PAGE 
TABLE 



/ 



/ 



HARDWARE 

PROCESS 

CONTROL 

BLOCK 



PROCESS 
HEADER (PHD) 



Figure 2-1 Process Data Structures 



• Software Process Control Block (PCB) - Holds process 
specific data that must always be available, even if 
process outswapped (i.e., process state, pointer to 
process header) . 

• Process Header (PHD) - Contains process specific data 
needed only when process is memory resident (i.e., P0 and 
PI page tables) . 

• Hardware Process Control Block - Contains saved contents 
of general purpose and memory management registers. 

• Job Information Block (JIB) - Keeps track of resources for 
a detached process and all its subprocesses. 
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SOFTWARE PROCESS CONTROL BLOCK (PCB) 



STATE QUEUE FORWARD LINK 



STATE QUEUE BACKWARD LINK 



TYPE | SIZE 



SCHEDULING 
INFORMATION 



RESOURCES 



POINTERS TO 
OTHER DATA 
STRUCTURES 



LISTHEADS 



NAMES & PRIVILEGES 



• VMS standard queue 
header 

• Size of nonpaged 
pool allocation 

Scheduling Information 

• Priority 

• Status 

Resident /outswapped 
Swap/noswap 

• State 

Resources 

• I/O limits 

• Subprocess count 

Pointers to: 

• Process header 

• Hardware PCB 

• JIB 

• Event flag cluster 

Listheads 

• AST queue 

• Lock queue 

Names and Privileges 

• Process ID (PID) 

• Login UIC 

• Privilege mask 



Figure 2-2 Software Process Control Block (PCB] 
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PROCESS HEADER (PHD) 



PROCESS PRIVILEGES 
SAVED REGISTERS 



WORKING SET LIST 



USED TO LOCATE IMAGE 
SECTIONS IN IMAGE FILES 



T 



~4~ - 



VIRTUAL TO PHYSICAL 
ADDRESS MAPPING 



• Privilege mask 



• Hardware process control 
block 



• Working set listA^ 



• Process section tab 






UiCB 



> 



• P0 page table 

• PI page table 



Figure 2-3 Process Header (PHD) 
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PRIVILEGED VS. GENERAL REGISTERS 



Privileged 



Can only be accessed in kernel mode using MTPR, MFPR 
instructions 

Types : 

Clock Registers 

Time of Year (PR$_TODR) 
Interval (PR$_ICR) 

Pointers to Data Structures 

Hardware Process Control Block (PR$_PCBB) 
System Control Block Base (PR$_SCBB) 

Hardware Error Registers 

SBI Error on 780 (PR$_SBIER) 
Cache Error on 750 (PR$_CAER) 

Other Registers 

Interrupt Priority Level (PR$_IPL) 
Software Interrupt Summary (PR$ SISR) 



General 



• Can be accessed in any access mode using most instructions 

• R0-Rll,AP,FP,SP f PC 
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HARDWARE PROCESS CONTROL BLOCK 



STACK POINTERS 



GENERAL PURPOSE 
REGISTERS 



OTHER REGISTERS 
STATUS INFORMATION 



MEMORY MANAGEMENT 
REGISTERS 



PR$_PCBB 

Pointers to: 

- Kernel stack 

- Executive stack 

- Supervisor stack 

- User stack 



R0, Rl, 



Rll 



Argument Pointer (AP) 
Frame Pointer (FP) 
Program Counter (PC) 
Processor status longword 

P0 base register 
PI base register 
P0 length register 
PI length register 



(PSL) 



Figure 2-4 Hardware Process Control Block 
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JOB INFORMATION BLOCK 




LIST OF 
AVAILABLE 
RESOURCES 
& LIMITS 



JOB INFORMATION 
BLOCK (JIB) 



PCB 



TK-8947 



Figure 2-5 Job Information Block 



A 30b consists of. a detached process and its subprocesses. 
The job information block (JIB) keeps track of resources allotted 
to a job, such as: 



• Limit on number of subprocesses (PRCLIM) 

• Open File Limit (FILLM) 
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VIRTUAL ADDRESS SPACE OVERVIEW 



1 


1 




PO 


P1 


so 





SEPARATE MAPPING 
FOR EACH PROCESS 



-. 



ONE MAPPING FOR 
ALL PROCESSES 



TK-8942 

Figure 2-6 Virtual Address Space 

Process Virtual Address Space 

P0 - Image, Run Time Library, Debugger 

PI - Command Language Interpreter, 
stacks, I/O data areas 

S0 - System services, Record Management 
Services, other executive code and 
data 
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SO VIRTUAL ADDRESS SPACE 




SYSTEM SERVICE VECTORS 



EXECUTIVE CODE 
& DATA 



FILE HANDLING 
ROUTINES 



ERROR MESSAGE TEXT 



DESCRIPTION OF PAGES 
IN PHYSICAL MEMORY 



SHARED DYNAMIC 
DATA STRUCTURES 



SHARED DYNAMIC 

DATA STRUCTURES 

INTERRUPT SERVICE ROUTINES 

DRIVERS 



• System service code 

• Scheduler 

• Report System Event 



RMS. EXE 



• SYSMSG.EXE 



PFN database 



• Paged pool 

• Global section descriptors 

• Non-paged pool 

• Software process control 
blocks 

• Unit control blocks 

• Lookaside list 

• I/O request packets 

• Timer queue elements 



Figure 2-7 S0 Virtual Address Space 
(Sheet 1 of 2) 
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STACK USED WHEN 
INTERRUPTS OCCUR 



TABLE FOR VECTORING 
BY HARDWARE TO 
SERVICE ROUTINES 



STORAGE FOR 
PROCESS HEADERS 



LOCATIONS OF VALID 
SYSTEM VIRTUAL ADDRESSES 

DATA STRUCTURES USED 
TO LOCATE GLOBAL SECTIONS 



LOCATION OF EACH 

PAGE OF SYSTEM 

VIRTUAL ADDRESS SPACE 



LOCATIONS OF 
GLOBAL PAGES 



Interrupt stack 



System control block (SCB) 



• Balance slots 



• System header 

- System working set list 

- Global section table 



System page table 



• Global page table 



Figure 2-7 S0 Virtual Address Space 
(Sheet 2 of 2) 
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PO VIRTUAL ADDRESS SPACE 



Native Mode Image 



Native Mode Image 



Run Time Library 



Debugger 



Traceback 



not mapped 



ft &£ 



Compatibility Mode Image 



f f J 



*» .1 



Compatibility 
Mode Image 



not mapped 



RSX-11M AME 



Native Mode Image 



not mapped 



POLR Pages 
3FFFFFFF 



End of Compatibility 
Mode Image 



177777 8 = FFFF 16 



POLR Pages 
3FFFFFFF 



Figure 2-8 P0 Virtual Address Space 
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P1 VIRTUAL ADDRESS SPACE 



Image-Specific 



_ Ju*JL-zr£ 



Process Specific 



Static 



User Stack 



Image I/O Segment 



Per-Process Message Section (si 



CLI Symbol Table 



CLI Image 



P1 Window to Process Header 



Channel Control Block Table 



Process I/O Segment fjl\y 



Per Process Common Area 



Per Process Common Area 



Compatibility Mode Data Page 



Process I/O Segment „■, 



Process Allocation Region 



Generic CLI Data Pages 



Image Activator Scratch Pages 



Debugger Context 



Vectors for Messages and User-Written System Services 



Image Header Buffer 



Kernel Stack 



Executive Stack 



Supervisor Stack 



System Service Vectors 



P1 Pointer Page 



Debugger Symbol Table££\ 




<f0$&MAr- 



:CTL$GL_CTLBASVA 



::MMG$GL_CTLBASVA 




4i*W 




7FFFFFFF 



Figure 2-9 PI Virtual Address Space 



Image Specific - Deleted on image exit 

Process Specific - Changes according to SYSGEN parameters 

and CLI used 
Static - Does not change 
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Table 2-1 Function of PI Space 



Function 



PI Area 



Images 



Symbol tables 



Pointers 



Stacks 



Command Language Interpreter 
(DCL, MCR, user written) 

Symbolic Debugger 

Command Language Interpreter 

System service vectors 
User written system service 
vectors 

PI window to process header 
(maps to PHD in S0 space) 

PI pointer page (i.e., 
CTL$GL_CTLBASVA) . (Address of 
primary, secondary, last 
change exception) 

Message vectors 
(per process messages) 

Kernel, executive, supervisor, 
user 



RMS data 

• Record of open 
files 



Error message text 

Storage area 

• Data stays around 
between images 



Other data areas 



Image I/O segment 
Process I/O segment 

Per process message section 



Per Process Common Area 
(LIB$GET_COMMON) 

Process allocation region 
(i.e., logical names) 

Generic CLI data pages 

Image Activator scratch pages 

Image header buffer 

Compatibility mode data page 

(used by AME) 

Channel control block table 

(links process to device) 
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SYSTEM MECHANISMS 



INTRODUCTION 

Most of the operations associated with an operating system 
can be described in terms of software components manipulating data 
structures. A variety of control mechanisms must be established 
to ensure that components competing for common resources do not 
interfere with each other or case a system "deadlock." Several 
hardware instructions provide support for these software 
mechanisms. Additional mechanisms control the accessibility of 
data structures. The user identification code (UIC) , file 
protection, and privileges are examples of qualitative controls. 
Quotas and limits are quantitative controls on system resources 
hat may have several synchronous allocations to a process. 

The implementation of an interrupt priority strcture provides 
a hardware-arbitrated mechanism for synchronizing device requests, 
some software component requests (such as scheduling and AST 
delivery) , and synchronizing the accessibility of some protected 
data structures. Interrupts are the result of asynchronous events 
occurring within VMS and the hardware configuration. 

Several interrupt priority levels are used to protect data 
structures by assuming that IPL is raised to the required IPL 
value. There must be a mechanism for seralizing requests for some 
of these data structures when the requesting software routine is 
executing at or above the desired IPL. The fork process mechanism 
provides this ability by requiring that an interrupt service 
routine or driver first drop IPL below the desired value, then use 
common code to raise the IPL value. Because the common code only 
services one request from its queue at a time, competing requests 
are serialized into exclusive accesses. 

Exceptions are synchronous events that result from actions 
within a particular process. Common examples include. 

• Translation not valid fault (page fault) 

• Divide by zero trap 

• Compatibility mode fault. 

Execution of most system services and record management 
services occurs as a result of change mode to kernel and change 
mode to executive exceptions (CHMK and CHME instructions) . 
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Privileges provide qualitative controls over classes of 
operations that may be requested by users. Privileges are granted 
through: 

• The user authorization file 

• The $SETPRV system service and the $SET PROCESS/PRIVILEGE 
command 

• Installation of a known image with enhanced privileges 

• User identification code (UIC) 

• The file protection mechanism. 

Quantitative control over user activities is also required, 
and is provided by several quota mechanisms. 

• Process-specific quotas or limits, such as the number of 
I/O requests, timer requests, and ASTs outstanding 

• Job-specific quotas, such as the number of subprocesses 
and the consumption of page file pages 

• User-specific quotas, such as disk consumption (based on 
UIC and volume/volume set) 

• System-wide limits based on system parameters, such as 
maximum process count. 

Mutual exclusion semaphores (mutexes) are a system mechanism 
used to synchronize concurrent accesses to a protected data 
structure by more than one process. Mutexes allow one process to 
write to the protected data structure or multiple processes to 
read the data structure. 

Dynamic memory (pool) is used to provide storage for various 
classes of VMS data structures. Process data structures are 
allocated from a dynamic memory area in the control (PI) region, 
system-wide data structures are allocated from either paged or 
nonpaged pools depending on the types of system components 
accessing them. 
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Asynchronous system traps (ASTs) provide an asynchronous 
method of communication and synchronization between VMS and a 
process. ASTs are used to: 

• Notify a process of the completion of an operation (I/O or 
a timer request, for example) 

• Force execution within the context of a target process 
(for example, $GETJPI to another process, forced process 
deletion, and return of status information after an I/O 
request completes) . 

Timer requests can be issued by user processes to defer 
action until some future time. Also, periodic wakeup requests of 
user processes and periodic executions of system routines are 
provided by the software timer, with support from the hardware 
clocks. 



OBJECTIVES 

Upon completion of this module, you will be able to: 

1. Describe how the various VAX/VMS protection, 
communication, and synchronization mechanisms are 
implemented, and why each of them is used. 

2. Discuss the SYSGEN parameters controlling various system 
resources (e.g., memory), and the effects of altering 
those parameters. 
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RESOURCES 

Reading 

• VAX/VMS Internals and Data Structures Manual , chapters on 
condition handling, system service dispatching, software 
interrupts, AST delivery, synchronization techniques and 
dynamic memory allocation. 

Additional Suggested Reading 

1. VAX/VMS Internals and Data Structures Manual , chapters on 
hardware interrupts, and timer support 

2. VAX-11 Architecture Handbook , Chapter 12 

3. VAX-11/780 Hardware Handbook , Chapter 12 

Source Modules 

Facility Name Module Name 



SYS 



SYS$EXAMPLES 



Macros 



RTL 



ASTDEL,SCHED 

CMODSSDSP 

EXCEPTION , SYSUNWIND 

MEMORYALC 

MUTEX 

TIMESCHDL 

SYSSCHEVT, SYSCANEVT 

FORKCNTRL 

IOCIOPOST 

USSDISP. MAR, USSLNK.COM 
USSTEST.MAR, USSTSTLNK.COM 

IFWRT, IFNOWRT, IFRD, IFNORD 
IFPRIV, IFNPRIV 
SETIPL,DSBINT,ENBINT 
LIBSIGNAL 
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TOPICS 

I. Processor and Process State 

II. Interrupts 

III. Access Modes and Exceptions 

IV. Synchronization 
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Table 3-1 Keeping Track of CPU, Process State 

Function Implementation Name 

Store processor Register Processor Status 

state Longword (PSL) 

Save, restore Instruction SVPCTX, LDPCTX 

process state 
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PROCESSOR STATUS WORD 



15 



8 



NOT USED 



DECIMAL OVERFLOW TRAP ENABLE — 
FLOATING UNDERFLOW TRAP ENABLE 
INTEGER OVERFLOW TRAP ENABLE — 
TRACE TRAP ENABLE '• 



it t t " 



NEGATIVE CONDITION CODE 

ZERO CONDITION CODE " 

OVERFLOW CONDITION CODE — — — — — — — 

CARRY (BORROW) CONDITION CODE 

Figure 3-1 Processor Status Word 



Low-order word of Processor Status Longword (PSL) 

Writable by nonpr ivileged users through 

- Special Instructions 
Entry masks 
Results of most instructions 
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PROCESSOR STATUS LONGWORD 



31 



20 



16 15 



J L 



PROCESSOR STATUS WORD 



t 



t 



INTERRUPT PRIORITY LEVEL 

PREVIOUS ACCESS MODE 

CURRENT ACCESS MODE 

EXECUTING ON THE INTERRUPT STACK 

INSTRUCTION FIRST PART DONE 

TRACE PENDING 

COMPATABILITY MODE 



Figure 3-2 Processor Status Longword 



• High-order word of Processor Status Longword (PSL) 

• Read-only to nonpr i vileged users 

• Changed as a result of CHMx , REI, MTPR instructions, 
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HARDWARE CONTEXT 



Process Header 



Hardware PCB 



Working Set List 

Process Section 
Table 

Accounting Info 



PO Page Table 

(Virtual 

Address Space 

Description) 



P1 Page Table 



PHD 



> 



PR$_PCBB 



Hardware Process 
Control Blocks 

• General Registers 

• PC, PSL 

• Per Process 
Stack Pointers 

• Memory 
Management 
Registers 

• ASTLVL 



(Hardware Context) 



Figure 3-3 Hardware Context 



The LDPCTX and SVPCTX instructions move the contents of the 
process-specific hardware registers to and from the hardware 
process control blocks of memory-resident processes. 

The hardware PCB contains the processor register information 
for a process when it is not currently executing. 
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HANDLING AND USES OF INTERRUPTS 



Table 3-2 Handling and Uses of Interrupts 



Function 



Implementation 



Name 



Arbitrate interrupt 
requests 

Service interrupts 
and exceptions 

Synchronize execu- 
tion of system 
routines 



Hardware maintained 
priority 

Table of service 
routine addresses 

Interrupt service 
routines 



Interrupt priority 
level (IPL) 

System control 
block (SCB) 

Timer, SCHED, IOPOST. 



Request an 
interrupt 



MACRO 



SOFTINT 



Synchronize sys- 
tem's access to 
system data 
structures 



MACRO-raise IPL to 7 



SETIPL 



Continue execution 
of code at lower 
priority 



Queue request, SOFTINT, FORK 
REI 
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HARDWARE INTERRUPTS AND SCB 





4 






PR$_SCBB 


Exceptions 


^ 












Processor Faults 






Software Interrupts 




Clock and Console 




Device Interrupts 










-• 



















:: EXE$GI SCB 



System Control Block 

Figure 3-4 Hardware Interrupts and SCB 



System Control Block (SCB) - physically contiguous area of 
system space 

Hardwar e register P R $ SCBB contains physical addxg sg — o_£- 
.SCB^^ 

Hardware gets service routine address from longword in SCB 
Size of SCB is CPU specific. 
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HARDWARE INTERRUPTS AND IPL 



Table 3-3 Hardware Interrupts and IPL 



FUNCTION 


VALUE 
(decimal) 


NAME 


Block all Interrupts 

Clock Interrupts 
Device Interrupts 

Driver Fork Levels 


31 

24 

20-23 

8-11 


IPL$_POWER 
IPL$_HWCLK 
UCB$B_DIPL* 
UCB$B_FIPL* 



Offset into Device's Unit Control Block 



• Interrupt Priority Levels (IPL) above 15 reserved for 
hardware interrupts 

• Peripheral devices interrupt at IPL 20 to 23 

• IPL$_XXXX - IPL level (see $IPLDEF) 

UCB$B_XXXX - Offset into UCB where device IPL and fork IPL 
are stored (see $UCBDEF) . 



83 



SYSTEM MECHANISMS 



SOFTWARE INTERRUPTS AND SCB 





4 






PR$_SCBB 


Exceptions 


% 












Processor Faults 






Software Interrupts 




Clock and Console 




Device Interrupts 










■# 



















:: EXE$GL_SCB 



System Control Block 

Figure 3-5 Software Interrupts and SCB 



Hardware gets service routine address from longword in SCB, 
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SOFTWARE INTERRUPTS AND IPL 



Table 3-4 SOFTWARE INTERRUPTS AND IPL 




USE 



.6+Nrfk'"4]J> 



»J)V 



Unused 

IPL=11 Fork Dispatching 
(IPL=10 Fork Dispatching) \ 
(IPL=9 Fork Dispatching)/ 
IPL=8 Fork Dispatching - ***■*$ 
Software Timer Service Routine 
IPL=6 Fork Dispatching^ — fa*. 
Used to Enter XDELTA 
I/O Post Processing 



Rescheduling Interrupt 
AST Delivery Interrupt 
Unused 



A9& 





• Interrupt Priority Levels (IPL) 1 through 15, reserved for 
software interrupts 



• IPLs 2-11 currently used. 



Jp£, CLAW**- 
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SOFTWARE INTERRUPT REQUESTS 



31 



4 3 



IGNORED 



REQUEST 



PR$_SIRR Software Interrupt Request Register 

(Write Only) 



31 



16 15 



1 



MBZ 


PENDING SOFTWARE INTERRUPTS 
F I E l D l C l B f A l 9 l S l 7 l 6 1 5 l 4 l 3 l 2 1 1 


M 
B 

Z 



PR$_SISR 



Software Interrupt Summary Register 
(Read/Write) 



Figure 3-6 Software Interrupt Requests 

Software Interrupt Summary Register 

• Bits 1 through 15 correspond to IPL 1 through 15. 

• Bit set indicates pending software interrupt request. 

• Interrupt is serviced as IPL drops below specified level, 
when REI is issued. 

Software Interrupt Request Register 

• To set bit in SISR, write IPL value to SIRR. 

• Use SOFTINT macro: 

.MACRO SOFTINT IPL 

MTPR IPL,S~#PR$_SIRR 
.ENDM SOFTINT 
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LOWERING IPL 

IPL 23 interrupt 

Driver int. service routine 

• Processing at IPL 23 

• Queue UCB to fork 
dispatcher (PC in UCB) 

• Request IPL 8 interrupt 

• REI 



IPL 8 interrupt 

Fork dispatcher service 
routine 

fit queue empty, REI 

Dequeue UCB 

JSB to PC in UCB 

'Loop 



PC: Driver 
Processing @IPL i 

RSB 


I 








FORK 


















QUEUE 










LISTHEAD 


PC 


PC 




UCB 




UCB 

TK-8943 



Figure 3-7 Fork Queue 
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BLOCKING INTERRUPTS 



Table 3-5 Blocking Interrupts 



WHAT TO BLOCK 


RAISE IPL TO 
(decimal) 


NAME 


All Interrupts 

Clock Interrupts 

Device interrupts 

Access to 
Scheduler's Data 
Structures 

Delivery of ASTs 
(Prevent Process 
Deletion) 


31 

24 

20-23 

7 

2 


IPL$_P0WER 
IPL$_HWCLK 
UCB$B_DIPL* 
IPL$_SYNCH 

IPL$_ASTDEL 



Offset into Device's Unit Control Block 



IPL can also be used to block interrupt servicing. 
IPL$_SYNCH is used to coordinate accesses to critical VMS data 
structures, such as the software . PCBs within the scheduler's 
database . 
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RAISING IPL TO SYNCH 

Convention: raise to IPL$_SYNCH (IPL 7) to access scheduler 
data base (PCBs, PHDs , etc). 



IPL 



23- 



8- 
7- 

6- 


o 




o 


o 


o 










TIME 






TK-8945 



Figure 3-8 Raising IPL to SYNCH 



O Software timer at IPL 7 

O Device interrupt - driver code at IPL 23 

O Driver forks to IPL 8, then requests IPL 6 interrupt 

O Software timer at IPL 7 

O Driver fork to IPL 6 

O Driver raised to IPL 7 
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HOW USER EXECUTES PROTECTED CODE 

Table 3-6 Executing Protected Code 



Function Implementation Name 

Protect memory from Hardware maintained Kernel, Executive, 

read/write access modes Supervisor, User 

Change access mode Instruction CHMx , REI 

Enter system service, Call — > instruction CALL_x — > CHMx 
RMS, user written 
system service 
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ACCESS MODE TRANSITIONS 



CHMx 




REI 



Figure 3-9 Access Mode Transitions 



Only way to move from less privileged to more privileged 
access modes 



• Only way to move from more privileged to less privileged 
access modes 

• Checks for illegal or unauthorized transitions. 
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CHMX AND REI INSTRUCTIONS 
CHMX 

CHMx CODE* 

• Stack pointer switches to appropriate mode 

• PSL, PC and sign-extended code pushed onto stack 

SP — > 



Sign- 


-extended 


code 


PC 


of 


next instruction 


Old PSL 



• PSL zeroed (except for IPL, CM, PM) 

• Current mode of PSL moved to previous mode field 

• Current mode changed to appropriate mode 

• New PC taken from system control block (SCB) . 



REI 



Replaces current PC and PSL with two longwords popped from the 
stack. 

Before doing so, 

1. Various checks are made to protect the integrity of the 
system. 

2. Checks for pending ASTs . 

3. Checks for pending software interrupts. 

4. After placing the PC and PSL in temporary registers, the 
SP is switched to the appropriate access mode based on the 
current mode field of the PSL. 
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REI OCCURS IN FOUR DIFFERENT CONTEXTS 

1. To provide user-initiated access to system code and data 

CHMx CODE 

REI 

2. To service and dismiss a hardware interrupt: 

Hardware Interrupt (IPL 16 through 31) 

REI 

3. To switch to compatibility mode: 

PUSHL PSL (Bit 31 set) 
PUSHL PC 

REI 

4. To service and dismiss a software interrupt: 

Software Interrupt (IPL 1 through 15) 



REI 
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INTERRUPTS VS. EXCEPTIONS 



Table 3-7 Differences Between Interrupts and Exceptions 



Interrupts 



Exceptions 



Asynchronous to the execution 
of a process 

Serviced on the system-wide 
interrupt stack in system- 
wide context 

Change the interrupt 

priority level to that 

of the interrupting device 

Cannot be disabled, although 
lower priority interrupts 
are queued behind higher 
priority interrupts 



Caused by process instruction 
execution. 

Serviced on the process local 
stack in process context. 



Does not alter interrupt 
priority level 



Some arithmetic traps can 
be disabled. 



\ 



&- 






J^fcT 1 
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EXCEPTIONS AND SCB 



Exceptions 



Processor Faults 



Software Interrupts 



Clock and Console 



Device Interrupts 




PR$_SCBB 



:: EXE$GI SCB 



System Control Block 

Figure 3-10 Exceptions and SCB 



Exceptions are serviced by system routines that are initially 
dispatched through the system control block. 
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EXCEPTION AND INTERRUPT DISPATCHING 



/software^ © 

^detected ) 



/HARDWARE^ 
^ DETECTED J 



® 




EXCEPTION 
MODULES 



SCB 

© 
© 




® 
























• * 
• 
» ^ 






EXCEPTION 
DISPATCHER 

© 




LIB$SIGNAL 

© 




* 




♦ 






SEARCH ROUTINE 






* t 






CONDITION 
HANDLERS 





Figure 3-11 Exception and Interrupt Dispatching 
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Notes to Figure 3-11: 

1. PSL, PC and to 2 longwords pushed onto stack 
Exceptions/interrupts treated by VMS 
Exceptions not treated by VMS 



2. 
3. 

4. 



5. 
6. 



Routines that push "SS$exception_name" and "N" (total of 
lw now in completed signal array) onto stack. Notes 1+2 
= sicmai— axra^ 



Detected and signaled by Executive 



a. Builds mechanism array and argument 

b. Search order 

1. Primary exception 

2. Secondary exception 

3. Call frames (maximum 64K) 

4. Last chance 

7. Alternate condition handling mechanism 

a. Signaled by RTL or a user 

b. Search mechanism - same as (F)-2. 
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PATH TO SYSTEM SERVICE 



PO 
Space 



User Program 



CALLx 




P1 

Space 



System 
Service Vector 

SVS$service :: 
entry mask 
CHMx *code 
RET 




System Space 



Change 
Mode Dispatcher 

EXESCMODxxxx :: 

1) Build call frame 

2) Check argument 
list 

CASEW 



offsets 



process illegal 
change mode 
codes 




Service Specific 
Procedure 



EXE$service : 
entry mask 



RET 



Common Exit Path 



Figure 3-12 Path to System Service 



System services that execute in kernel or executive access 
modes are invoked by: 

O A call to a system service vector. 

Q A change mode instruction. 

Dispatching through a CASE instruction in the CMODSSDSP 
module . 
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RETURN FROM SYSTEM SERVICE 



PO 
Space 



User Program 



CALLx 



P1 

Space 




System 
Service Vector 

SYSSservice :: 
entry mask 
CHMx #code 
RET 



System Space 




Change 
Mode Dispatcher 

EXE$CMODxxxx :: 

1) Build call frame 

2) Check argument 
list 

CASEW 



offsets 



process illegal 
change mode 

codes 



Common Exit Path 
SRVEXIT: 

REI 




Service Specific 
Procedure 



EXE$service 
entry mask 



RET 



Figure 3-13 Return from System Service 



Q System services return through a common code sequence, 
SRVEXIT, that checks the return status code and causes a 
system service failure exception if that feature has been 
enabled and the service has failed. 

Q REI from CHMx exception service routine. 

RET for original CALL. 
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NONPRIVILEGED SYSTEM SERVICE 



User Program 



CALLx 



System Space 




Service Specific 
Procedure 



EXESservice .: 
entry mask 



Figure 3-14 Nonpr ivileged System Service 



Q System services that do not require a change of access 
mode have a simpler control passing sequence. 

• $FAO 

• Timer conversion services 



Q Same as 1. 



These services are not checked by SRVEXIT for error status 
codes . 
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PATH TO RMS 



PO 
Space 



User Program 



CALLx 




P1 

Space 



RMS Service Vector 



SYSSservice 

entry mask 
CHME scode" 
BRB 




System Space 



Change 
Mode Dispatcher 

EXESCMODEXEC :: 

1) Build Call Frame 

2) Check Argument 
List 

CASEW 



offsets 



JSB< 



Common Exit Path 



RMS Synchronization 
Routine 



Figure 3-15 Path to RMS 

Q Same path as executive mode system service 

Q Same as 1. 

Q Falls off end of system service case table 
JSB to RMS case table. 

O Dispatch to RMS procedure. 




RMS Dispatcher 
RMSSDISPATCH: 
CASEW — 



offsets 



RSB 



® 



RMS Service Specific 
Procedure 



RMSSservice 
entry mask 



RET 
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RETURN FROM RMS 



PO 
Space 




System Space 



Change 
Mode Dispatcher 

EXESCMODEXEC :: 

1) Build Call Frame 

2) Check Argument 
List 

CASEW 

offsets 



Common Exit Path 
SRVEXIT: 



RMS Synchronization 
Routine 

RMSCHK STALL: 



RET 



RMS Dispatcher 
RMSSDISPATCH: 

CASEW 

• 

offsets 
RSB 




RMS Service Specifi 
Procedure 



RMS$service :: 
entry mask 



RET 



Figure 3-16 Return from RMS 

Q Same path as system service. 

Q Same as 1. 

O Extra step to manage the synchronous nature of most RMS 
operations . 

Q RET for original CALL. 



I/O 
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PATH TO USER WRITTEN SERVICE (1) 







PO 




P1 




SYSTEM 




SPACE 




SPACE 


j SPACE 




User Program 




JSB A 








RSB 










CALU 








Change Mode 










Dispatcher 












1) Build call frame 








© 








2) Check argument 

list 
CASEW 

• 












• 
offsets 

• 
• 




► .ENTRY 




VECTORS 


RET 

• 
• 
• 


• © I 


• 
JSB 

process illegal 
change mode codes 

• 
• 




CASE 

• 
• 


DISPATCHER 


offsets 

• 




• 
Common Exit Path 




• 
RSB 




SRVEXIT : 

• 
• 
• 




ENTRY 

• 


PROCEDURES 


• 
RET 




REI 








• 
« 
• 











Figure 3-17 



Path to User Written System Service 
(Sheet 1 of 2) 



O To find the appropriate user-written service, a user 
program calls a global symbol defining a service entry 
vector. 

O A change mode instruction with a negative code c auses the 
change mode dispatcher to look tor user-writiten system 
service dispatchers in the image. 
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PATH TO USER WRITTEN SERVICE (2) 




® 



VECTORS 



DISPATCHER 



PROCEDURES 



.ENTRY 

CHMX 

RET 



P1 

SPACE 



JSB A 



RSB 



SYSTEM 
SPACE 



Change Mode 
Dispatcher 

EXESCMODxxxx :: 

1) Build call frame 

2) Check argument 
list 

CASEW 



offsets 

• 
■JSB 

process illegal 
change mode codes 



Common Exit Path 
SRVEXIT : 

REI 



Figure 3-17 



Path to User Written System Service 
(Sheet 2 of 2) 



Q Code for user-written system service causes JSB at end of case 
table to be executed. 

Q When a request can be serviced, the user-written dispatcher 
passes control through a CASE instruction to the routine. 

O Same as 4. 
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RETURN FROM USER WRITTEN SERVICE 





PO 
SPACE 


1 
1 
1 


P1 

SPACE 




User Program 
^ CALL* 


JSB A 




RSB 













© 



VECTORS 



DISPATCHER 



PROCEDURES 



ENTRY 
CHMX 

RET +■ 



► 



© 



SYSTEM 
SPACE 



Change Mode 
Dispatcher 

EXESCMOOxxxx :: 

1) Build call frame 

2) Check argument 
list 

CASEW 
• 

offsets 



JSB 

process illegal 

change mode codes 

Common Exit Path 



■► SRVEXIT 
- REI 



Figure 3-18 Return from User Written System Service 



O When the user-written routine exits, it passes 
SRVEXIT, as the supplied system services do. 



control to 



The rest of the return path to the user program is similar to 
the steps for the supplied system services. 

O Same as 7. 
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TWO DISPATCHERS 





PO 
SPACE 




P1 
SPACE 


. SYSTEM 
I SPACE 




User Program 

• 

• 

• 

CALLx 

• 
• 
• 




JSB A 






JSB B 








RSB 




Change Mode 
Dispatcher 

EXESCMODxxxx :: 
















1) Build call frame 

2) Check argument 
list 


VECTORS 






DISPATCHER 




CASEW 

• 


PROCEDURES 




• 








offsets 

• 


VECTORS 


.ENTRY 

CHMX 

RET 

• 
• 

• 




• 

• 
JSB 

process illegal 
change mode codes 


DISPATCHER 


CASE 

• 

• 

• 

offsets 

• 
• 
• 
RSB 


• 
• 
• 
Common Exit Path 

SRVEXIT : 




ENTRY 

• 
• 
• 

RET 

• 
• 
• 


• 
• 
• 
REI 


rHULtUUKto 







Figure 3-19 Two Dispatchers 



• Multiple dispatchers can be linked to an image 

• Dispatchers are searched in order linked. 

• Duplicate CHMx code numbers possible. 

Only first occurrence recognized. 
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PROCESS SYNCHRONIZATION 



Table 3-8 Process Synchronization 



Function 



Implementation 



Name 



Synchronize access Semaphore 
to data structures 
by processes 



Mutex 



Allow process to REI Asynchronous system 

execute procedure on IPL 2 interrupt ser- trap (AST) 
completion of event vice routine 



Allow process to Hardware clock 
request action at a interrupt 
certain time Queue of requests 



Timer queue 
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MUTEX 



31 




17 16 15 







Status 


Ownership Count 



t 



Write-in-Progress or 
Write-Pending Flag 



Figure 3-20 A Mutex 






Mutexes protect lists of data structures 
conflicting accesses by multiple processes. 

One writer or multiple readers are allowed. 

Examples : 

- Group logical name tables 
System logical name table 



against 
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OBTAINING AND RELEASING MUTEXES 



To Obtain a Mutex 

MOVAL G~IOC$GL_MUTEX,R0 
MOVL G~SCH$GL_CURPCB,R4 
JSB G~SCH$LOCKR ;read 
G~SCH$LOCKW ;write 



Abdwr 






When returns, have mutex, 
but R2-R5 altered, at 
IPL=2 

To Release a Mutex 

MOVAL G~IOC$GL_MUTEX,R0 
MOVL G~SCH$GL_CURPCB,R4 
JSB G~SCH$UNLOCK 
SETIPL #0 

All mutex symbols defined in 
module SYSCOMMON, except for 
line printer mutex in LPDRIVER. 
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DYNAMIC MEMORY 



}M 



USED 



Size of this Block 

First Unused 
Block 



USED 



Size of this Block 



Next Unused 
Block 







M 



£$ ^ *" 



Beginning of Pool Area 
(Filled in When 
System is Initialized) 



r 



0- 



<k 



&' 



P 



t»? 



#' 





Address of First 

Free Block 

(Modified by Allocation 

and Deallocation Routines) 



Size of this Block 



Last Unused 
Block 



(Zero in Pointer 
Signifies End of List) 




Figure 3-21 Dynamic Memory 



Dynamic memory regions, or pools, are used for the management 
of data structures that must be allocated and deallocated after 
the system or process is initialized. Free blocks are stored in 
order of ascending addresses. 
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ALLOCATING NON-PAGED POOL /J^J) 



Rest of 

Nonpaged 

Poo 




MMG$GL_NPAGEDYN 



EXE$GL_NONPAGED +4 



IOC$GL_LRPSPLIT 
IOC$GL_LRPFL </$«•«*#*) 

EXE$GL_SPLITADR 
IOC$GL_JRPFL {M%JrA%txr*§ 

IOC$GI SRPSPLIT 

IOC$GL_SfiPFL (rqZhjfc&'s) 



Figure 3-22 Allocating Non-Paged Pool 
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RELEVANT SYSGEN PARAMETERS FOR NON-PAGED POOL 

NPAGEDYN - number of bytes pre-allocated for the non-paged dynamic 
pool, exclusive of the lookaside lists 

NPAGEVIR - number of bytes to which the non-paged pool may be 
extended . 

LRPCOUNT - number of large request packets pre-allocated for the 
LRP lookaside list. 

LRPCOUNTV - number of LRPs to which the LRP list may be extended. 

LRPSIZE - number of bytes to allocate per LRP, exclusive of 
header. Number of bytes actually allocated per packet is LRPSIZE 
+ 64. 

IRPCOUNT - number of I/O request packets pre-allocated for the IRP 
lookaside list. 

IRPCOUNTV - number of IRPs to which the IRP list may be extended. 

SRPCOUNT - number of small request packets pre-allocated for the 
SRP lookaside list. 

SRPCOUNTV - number of SRPs to which the SRP list may be extended. 

SRPSIZE - number of bytes to allocate per SRP. 

Notes : 

1. System page table entries are reserved and physical memory 
pre-allocated for NPAGEDYN, LRPCOUNT, IRPCOUNT, and 
SRPCOUNT. 

2. System page table entries are reserved but no physical 
memory pre-allocated for NPAGEVIR, LRPCOUNTV, IRPCOUNTV, 
and SRPCOUNTV. Physical memory will be allocated on 
demand from the free page list. 

3. Size of IRP's is 160 bytes. 
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ASTs 

Software Process Control Block (PCB) 



ASTQFL 



ASTEN | ASTACT 



ASTQBL 



ASTCNT 



AST Control Block (ACB) 



ASTQFL 



ASTQBL 

RMOD | TYPE | 



SIZE 



PID 



AST 



ASTPRM 



KAST 



*7**3 




Figure 3-23 ASTs 



11 



SPARE MODE 

QUOTA 
KAST 



AST control blocks are queued to the software process control 
block based on: 

• The access mode in which the associated request was made 

• The order in which the ASTs are reported to the system. 

Delivery of an AST depends on: 

• The current access mode of the process 

• Whether the access mode of the AST is enabled 

• Whether an AST is already active in the same access mode. 
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Rules for AST Delivery 

AST DELIVERY ORDER: 



SPECIAL K 
AST 



KERNEL 
AST 



EXEC 
AST 



SUPER 
AST 



USER 
AST 



V "T^V -7~V ~7^\ 

KERNEL EXEC SUPER USER 



TK-8944 



Figure 3-24 AST Delivery Order 



AST control blocks (ACBs) are queued to the PCB in order 
(Special K, Kernel, Exec, Super, User). 

ASTLVL = 4 if no ACBs, AST delivery is disabled or an AST 
is Active 

ASTLVL = if AST is Special K AST; 

ASTLVL = level of first AST 



Note : 

ASTLVL 


1 
2 
3 
4 



Deliverable ASTs 

Kernel 
Exec 
Super 
User 



Access Mode Code 

Kernel 

Exec 1 

Super 2 

User 3 



Some Special K ASTs 

• I/O completion 

• Suspend another process 

• GETJPI on another process, 
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AST Delivery Sequence £ c h $ 6.$^' 



Exception/ Interrupt 
Service Routine 
(i.e. Scheduler) 




No Ast 
Delivered 



IPL 2 INT 
Generated 



I 



SCHSASTDEL: 



(Recompute ASTLVL) 
REI 




Special K 
AST 

IPL=2 



USER 
AST 

IPL=0 



Figure 3-25 AST Delivery Sequence 



Table 3-9 Rules for Selection of ASTs 



Rule 



Example 



a) ASTLVL > new access 
mode 

b) ASTLVL < new access 
mode 



User AST (3) > kernel access mode (0) 
Super AST (2) < super access mode (2) 



c) Interrupt stack active (IS) bit set in PSL 

d) Final IPL > 2 IPL = 3 scheduler 
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TIMER QUEUE ELEMENT 



TQFL 


TQBL 


RQTYPE 


TYPE SIZE 


PID/PC 


AST/FR3 {JkJk. ^ 


ASTPRM/FR4f*p *|\ 


— TIME — 


— 


DELTA — 


! EFN I RMOD 


RQPID 



? 

J 



&rf> 



JfaA 



TQE$B_RQTYPE 
7 6 5 3 2 10 



T 



MO Process timer request 

1 System subroutine request 

2 Scheduled wake request 

"0 One-time request 

.1 Repeat request 

\1 AST is associated with 



timer event 

Figure 3-26 Timer Queue Element 

The timer queue element is inserted in the timer queue 
based upon the absolute expiration time of the 
request. 

Scheduled wake-up and system subroutine requests may 
have a delta time specified for recurring events. 

The AST routine, AST parameter, and event flag fields 
are filled from the system service argument list. 
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CLOCKS AND TIMER SERVICES 



TIMER QUEUE (ELEMENTS ORDERED BY EXPIRATION TIME) 

























EXE$GL_TQFL 



CURRENT SYSTEM TIME 



1 EXE$GQ_SYSTIME 

TIME OF DAY CLOCK 

1 PR$_TODR 



INTERVAL CLOCK 



j PR$_NICR (NEXT INTERVAL COUNT) 



QUANTUM 



PR$_ICR (INTERVAL COUNT) 



SCH$GL_CURPCB 
PHD 




QUANT 

(10 MSEC INCREMENTS) 



Figure 3-27 Clocks and Timer Services 



TK-8951 
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SUMMARY OF SYSTEM MECHANISMS 



Table 3-10 Function and Implementation of System Mechanisms 



Function 



Implementation 



Name 



Keeping Track of CPU f Process State 



Store processor 
state 

Store, restore 
process state 



Register 



Instruction 



Handling and Uses of Interrupts 



Arbitrate interrupt 
requests 

Service interrupts 
and exceptions 

Synchronize execu- 
tion of system 
routines 



Hardware maintained 
priority 

Table of service rou- 
tine addresses 

Interrupt service 
routines 



Request an interrupt MACRO 

Synchronize system's MACRO-raise IPL to 7 
access to system 
data structures 



Continue execution 
of code at lower 
priority 



Queue request, 
SOFTINT, REI 



How User Executes Protected Code 



Protect memory from 
read/write 

Change access mode 

Enter system ser- 
vice RMS, user 
written system 
service 



Hardware maintained 
access modes 

Instruction 

Call — > instruction 



Processor status 
longword (PSL) 

SVPCTX, LDPCTX 



Interrupt priority 
level (IPL) 

System control block 
(SCB) 

Timer, SCHED, IOPOST. 



SOFTINT 
SETIPL 

FORK 



KERNEL, Executive, 
Supervisor, User 

CHMx, REI 

CALL x — > CHMx 
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Table 3-10 Function and Implementation of System 

Mechanisms (Cont) 



Function 



Implementation 



Name 



Process Synchronization 

Synchronize access Semaphore 
to data structures 
by processes 



Allow process to 
execute procedure 
on completion of 
event 

Allow process to 
request action at 
a specific time 



MUTEX 



REI Asynchronous system 

IPL2 interrupt service trap (AST) 
routine 



Hardware clock 

interrupt 

Queue of requests 



Timer queue 
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COMMONLY USED SYSTEM MACROS 
IPL Control Macros 

.MACRO SETIPL IPL 

.IF NB IPL 

MTPR IPL,S~#PR$_IPL 

.IFF 

MTPR #31,S"#PR$_IPL 

. ENDC 



.ENDM 


SETIPL 




.MACRO 


DSBINT : 


EPL,DST 




.IF B 


DST 




MFPR 


S~#PR$_IPL,-(SP) 




.IFF 






MFPR 


S~#PR$_IPL,DST 




.ENDC 






.IF B 


IPL 




MTPR 


#31,S~#PR$_IPL 




.IFF 






MTPR 


IPL,S~#PR$_IPL 




.ENDC 




.ENDM 


DSBINT 




.MACRO 


ENBINT 


SRC 




.IF B 


SRC 




MTPR 


(SP)+,S~#PR$_IPL 




.IFF 






MTPR 


SRC,S~#PR$_IPL 




.ENDC 




.ENDM 


ENBINT 




.MACRO 


SOFTINT 


IPL 




MTPR 


IPL,S~#PR$_SIRR 


.ENDM 


SOFTINT 





APPENDIX A 



Example 3-1 IPL Control Macros 
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Argument Probing Macros 

.MACRO IFRD SIZ , ADR, DEST, MODE=#0 
PROBER MODE, SIZ, ADR 
BNEQ DEST 

.ENDM IFRD 

.MACRO IFNORD SIZ , ADR, DEST, MODE=#0 

PROBER MODE, SIZ, ADR 

BEQL DEST 

.ENDM IFNORD 

.MACRO IFWRT SIZ , ADR, DEST, MODE=#0 

PROBEW MODE, SIZ, ADR 

BNEQ DEST 

.ENDM IFWRT 

.MACRO IFNOWRT SIZ , ADR, DEST, MODE=#0 
PROBEW MODE, SIZ, ADR 
BEQL DEST 

.ENDM IFNOWRT 



Example 3-2 Argument Probing Macros 
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Privilege Checking Macros 

.MACRO IFPRIV PRIV,DEST,PCBREG=R4 
.IF DIF <PRIV>,<R1> 
.IF DIF <PRIV>,<R2> 
BBS #PRV$V 'PRIV,@PCB$L PHD (PCBREG) , DEST 



ENDM 



.IFF 

BBS 

.ENDC 

.IFF 

BBS 

.ENDC 

IFPRIV 



PRIV,@PCB$L_PHD (PCBREG) , DEST 
PRIV,@PCB$L PHD ( PCBREG ), DEST 



.MACRO IFNPRIV PRIV, DEST, PCBREG=R4 

.IF DIF <PRIV>,<R1> 

.IF DIF <PRIV>,<R2> 

BBC #PRV$V_' PRIV, §PCB$L_PHD (PCBREG) ,DEST 

.IFF 

BBC PRIV, @PCB$L_PHD (PCBREG) , DEST 

.ENDC 

.IFF 

BBC PRIV, @PCB$L_PHD (PCBREG) , DEST 

.ENDC 
.ENDM IFNPRIV 

Example 3-3 Privilege Checking Macros 
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Privilege Mask Locations 



Table 3-11 Privilege Mask Locations 



Symbol Name 



Use 



CTL$GQ PROCPRIV 



PCB$Q PRIV 



PHD$Q PRIVMSK 
(PHD Ease address) 



PHD$Q IMAGPRIV 



Process permanent mask 

Altered by $SET PROCESS/PRIV= command 
Used to reset current masks. 

Current mask, permanently resident. 
Altered by known image activation. 
Altered by $SETPRV system service. 
Reset by image rundown. 

Current mask, swappable 

Altered by known image activation. 
Altered by $SETPRV system service. 
Reset by image rundown. 
Used by IFPRIV, IFNPRIV macros. 

Mask of installed known image 
ORed with CTL$GQ_PROCPRIV to 
Produce current masks. 



PHD$Q AUTHPRIV 



Mask defined in authorization file 
Not changed during life of process. 
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APPENDIX B 



THE REI INSTRUCTION 

The REI instruction will result in a reserved operand fault 
if any one of the following operations is attempted 

1. Decreasing the access mode value (to a more privileged 
access mode). (This is a comparison of the current mode 
fields of both the present PSL and the saved PSL on the 
stack.) 

2. Switching to the interrupt stack from one of the four 
perprocess stacks. 

3. Leaving the processor on the interrupt stack in other than 
kernel access mode. 

4. Leaving the processor on the interrupt stack at IPL 0. 

S5. Leaving the processor at elevated IPL (IPL > 0) and not in 
^fs\ kernel access mode. 

6. Restoring a PSL in which the previous mode field is more 
privileged than the current mode field (previous mode < 
current mode) . 

7. Raising IPL. 

8. Setting any of the following bits - PSL<29:28> or PSL<21> 
or PSL<15:8>. 



When the processor attempts to enter compatibility mode, the 
following checks are made. 

1. The first-part-done bit must be clear. 

2. The interrupt stack bit must be clear. 

3. All three arithmetic trap enables (DV, IV, and FU) must be 
clear. 

4. The current mode field of the saved PSL must be user 
access mode . 
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If all the preceding checks are performed without error, the 
REI microcode continues by: 

1. Saving the old stack pointer (SP register) in the 
appropriate processor register (KSP, ESP, SSP, or USP) . 

2. Setting the trace pending bit in the new PSL if the trace 
pending bit in the old PSL is set. 

3. Moving the contents of the two temporaries (note 1 above) 
into the PC and PSL processor registers. 

If the target stack is a perprocess stack: 

1. Getting the new stack pointer from the corresponding 
processor register (KSP, ESP, SSP, or USP) 

2. Checking for potential deliverability of pending ASTs. 
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DEBUGGING TOOLS 



INTRODUCTION 

Since VMS runs in Executive and Kernel modes and at elevated 
interrupt priority levels, any error is considered serious, and 
may cause a system crash. 

VMS offers several tools to aid in debugging system level 
code. These tools are: 

• SDA a symbolic dump analyzer 

• DELTA - a debugger for code running in operating modes 
from user to kernel. 

• XDELTA a debugger for kernel mode code running at elevated 
IPLs. 



OBJECTIVES 

Upon completion of this module, given the lecture notes, you 
will be able to: 

1. Use various system-supplied debugging tools and utilities 
(e.g., SDA, DELTA, XDELTA) to examine crash dumps and to 
observe a running system. 

2. Use the system map file as an aid in reading source code, 
and identifying the source of system crashes. 



RESOURCES 

1. VAX/VMS System Dump Analyzer Reference Manual 

2. VAX/VMS PATCH Utility Reference Manual 

3. VAX Hardware Handbook 

4. VAX/VMS Guide to Writing a Device Driver 
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TOPICS 

I. Crash Dumps and Bugchecks (System Errors) 

A. What they are 

B. How they are generated 

C. Fatal and nonfatal system errors 

D. Sample system errors and stack output 
II. The System Map File (SYS. MAP) 

A. Contents and format 

B. How to use it 

1. For bugchecks 

2. For source code 

III. . The System Dump Analyzer (SDA) 

A. Commands 

B. Crash file analysis 

C. Active system analysis 
IV. Other Debugging Tools 

A. DELTA 

B. XDELTA 

C. CCL (console command language) 

D. PATCH 
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CRASH DUMPS 

A crash dump is generated when the system decides that it can 
not continue functioning. The system stops the normal flow of 
work and attempts to copy all the information in physical memory 
to a special file on a disk. 

Causes of Crash Dumps 

A crash dump is a result of a fatal error or inconsistency 
(fatal bugcheck) being recognized and declared by a component of 
the operating system. A bugcheck is declared by that component by 
referencing a central routine. Some reasons for declaring a fatal 
bugcheck are listed below. 

• Exception at elevated IPL 

• Exception while on interrupt stack 

• Machine check in kernel mode 

• BUG_CHECK macro issued 

• HALT instruction restart 

• Interrupt stack invalid restart 

• Kernel or executive mode exception without exit handler 

BUGCHECKS 

The Two Types of Bugchecks 

• Fatal - system must be taken down; no recovery possible 

• Continue - non-fatal; the system may attempt recovery. 

How Crash Dumps Are Generated 

• Written by the fatal bugcheck code 

• For a dump to be written 

Bugcheck must be fatal 

If non-fatal bugcheck, all bugchecks must be declared 
fatal (done by setting BUGCHECKFATAL = 1) 

DUMPBUG = 1 (requests dump on fatal bugcheck) 

- SYS$SYSTEM:SYSDUMP.DMP must be the correct size 

file size (in blocks) = physical memory (in pages) 
plus 4 pages 
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How Bugchecks Are Generated 

BUGCHECKS are generated by using the BUG_CHECK macro. 

BUG_CHECK QUEUEMPTY, FATAL 

generates 

.WORD ~XFEFF 

. WORD B UG $ QUE UEM PTY ] 4 

Bugchecks are generated by system components (EXEC, RMS, ACP, 
etc.) after detecting an internal (software) error. 

Table 4-1 Sample BUGCHECKS 

Name Module Type Description 

BADRSEIPL RSE Fatal Bad IPL at entrance to RSE 

FATALEXCPI EXCEPTION Fatal Fatal Exec or Kernel mode exception 

NOTPCB MUTEX Fatal Structure not PCB 

UNABLCREVA EXCEPTION Cont. Unable to create V.A. space 

NOTE 
When looking at the crash dump, PC minus 4 is 
that address at which the BUG_CHECK macro is 
referenced . 
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»>E P 

00000000 
>»E/G F 

G 
>»E/I 1 

I 
>»E/I 2 

I 
»>E/I 3 

I 
>»E/I 4 

I 



0OO00OOF 
00000001 
00000002 
00000003 
00000004 



>»D/G F FFFFFFFF 
»>D P 0O1F0O0O 
»>C 



80007BO6 
00000000 
00000000 
00000000 
8011DA0O 



**** FATAL BUG CHECK, VERSION = V3.0 INVEXCEPTN, Exception while above ASTDEL or on 
CURRENT PROCESS = NULL 
REGISTER DUMP 



RO = 
Rl = 
R2 = 
R3 = 
R4 = 
R5 = 
Ri = 
R7 = 
R8 = 
R? = 
R10= 
Rll = 
AP = 
FP = 
SP = 
PC = 
PSL= 



0000001F 
OOIFOOOO 
OOOOOOOO 
00000000 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOl; 
OOOOOOOO 
80000990 
80OO30C6 
O01FO0O9 



KERNEL/INTERRUPT STACK 



800009A0 
800009A4 
800009A8 
800009AC 
800009B0 
800009B4 
800009B8 
800009BC 
800009CO 
800009C4 
800009C8 
800009CC 
800009D0 
800009D4 
800009D8 
800009DC 
800009EO 
800009E4 
800009E8 
800009EC 
800009FO 
800009F4 
800009F8 



00000004 
OOOOOOOO 
FFFFFFFO 
OOOOOOOO 
OOOOOOOO 



f — MECHANISM ARRAY 



OOOOOOOC 
OOOOOOOI 
FFFFFFFI 
FFFFFFFF 
OOIFOOOO 



66060000 
OOOOOOOO 
OOOOOOOO 
OOOOOCO) 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 



-SIGNAL ARRAY 

-SS$_ACCVIO 
- REASON MASK 
-FAULTING V.A. 
-PC 
-PSL 



Example 4-1 Sample Console Output After Bugcheck 
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SAMPLE STACKS AFTER BUGCHECKS 
Access Violation 



SP- 





4 


7FFECDE4 


FFFFFFFD 


14 





5 


C 


1 


12 


8 5 2 18 4 


1 C 8 




• 
• 



ESTABLISHER FRAME 



DEPTH = -3 LAST CHANCE 



R0 



R1 



SS$_ACCVIO 



REASON 



VA 



PC 



PSL 



TK-8966 

Figure 4-1 Stack After Access Violation Bugcheck 
Probable Causes: 

• Blown register 

• Incorrect data structure field 

• Improper synchronization 
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Page Fault Above IPL 2 



SP- 



314 



80050200 



150000 



R4 

R5 

REASON 

VA 

PC 

PSL 



TK-8967 

Figure 4-2 Stack After Page Fault Above IPL-2 
Probable Causes: 

• Blown register in fork interrupt routine 

• Improper start I/O routine design 
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Reserved Operand Fault 



SP- 



454 



80051234 



00070000 



ESTABLISH ER FRAME 

DEPTH 

RO 

R1 

SS$_ROPRAND 

PC 

PSL 



TK-8964 

Figure 4-3 Stack After Reserved Operand Fault 
Probable Causes: 

• REI failure 

IPL problems (allocate memory at wrong IPL) 
Blown stack 

• RET failure 



136 



DEBUGGING TOOLS 



Machine Check in Kernel Mode (CPU Timeout) 



28 



80014300 



REASON = CPU TIMEOUT 



VA 



TIMEOUT SBI ADDR 



80053210 



1C1 50000 



PC 



PSL 



TK-8963 



Figure 4-4 Stack After Machine Check in Kernel Mode 



Reasons: 



• Accessing nonexistant UBA or SBI address 

• Corrupted page tables 

• Processor device or bus failure 
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SYSTEM MAP FILE 
Overview 

• MAP of linked executive 

• Available on every VMS system 
SYS$SYSTEM:SYS.MAP 

• Useful in debugging crash dumps and when reading source 
code 

Sections of SYS.MAP 

1. Object module synopsis 

• Listed in order processed by linker 

• Includes creation data and source language 

2. Image section synopsis 

• Lists base virtual address 

3. Program section synopsis 

• Lists PSECTs by base virtual address 

• Includes PSECT size and attributes 

4. Symbol cross-reference 

• Lists global symbols alphabetically 

• Includes symbol value, module (s) that define and 
reference it 

5. Symbols by value 

• Lists global symbols by hexadecimal value 

• Multiple symbols have same value 

6. Image synopsis 

• Miscellaneous information about the output image 

7. Link run statistics 

• Miscellaneous information about the link run that 
produced the image . 



138 



DEBUGGING TOOLS 

SYS.MAP and Crash Dumps 

1. Information in crash dumps given by value 

• Virtual address of code (PC) 

• Contents of data structures 

Virtual address references 

Symbolic references (i.e., State of process) 

2. SYS.MAP can be used to translate numbers to meaningful 
information. 

• Program section synopsis (V.A. — > source code 
module) 

• Symbols by value (value — > symbol name) 

SYS.MAP and Source Code 

1. Layout of linked Executive in S0 space 

• Program section synopsis 

2. Interrelationship of modules ("who references who") 

• Symbol cross reference 

3. Module entry points and global data locations. 
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VAX/VMS DEBUGGING TOOLS 

Under the VAX/VMS operating system, there are several ways to 
debug or analyze a problem that is occurring in a program. The 
method of analysis depends on the environment the program is 
running under and the nature of the analysis you wish to do (i.e., 
monitoring only, stepping through a program) . The table below 
describes the type of analysis, program environment, and the 
suggested method of analysis (the debugger). 



Table 4-2 Environment Vs. Debugging Tools 



Problem/Environment 



Method of Analysis 



Program IPL=0, 

User mode 

Examine per-process memory 



VAX/VMS Symbolic Debugger 
(Linked with image or 
included at run time, 
user mode only) 



Program IPL = 0, 
User to kernel 

mode 
Examine process 

and system memory 



DELTA debugger 

(Linked with an image or 

included at run time, 

User to kernel mode,) 

Nonsymbolic 



Examine active 
system 



System Dump Analyzer (SDA) 
Activated from DCL, can 
examine active system 



Examine a Crash file 



System Dump Analyzer (SDA) 
Activated from DCL 



Program IPL > 



XDELTA DEBUGGER 

(Linked with VMS, run from 

console terminal only) 

Nonsymbolic 
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THE SYSTEM DUMP ANALYZER (SDA) 
Uses 

The System Dump Analyzer (SDA) is used to examine: 

• The system dump file (SYS$SYSTEM:SYSDUMP.DMP) 

• A copy of the dump file containing previous crash 
information 

• The active system. 

Information Handling 

Through the SDA, information can be: 

• Displayed on a video terminal 

• Printed on a hardcopy terminal 

• Sent to a file/line printer. 

Requirements 

• SYS SYSTEM :SYSDUMP.DMP file must be large enough 
Size of file = physical memory plus 4 (in pages) 

• Dumpbug (a SYSGEN parameter) must be set (=1) by default, 
it is set. 

• Console must be allowed to finish printing the bugcheck 
output. 

• To run SDA: 

- VIRTUALPGCNT > SYSDUMP.DMP + 1000 (pages) 

- PGFLQUOTA > SYSDUMP.DMP + 1000 (pages) 

• To examine the active system, the CMKRNL privilege is 
needed. 

• To examine a dump file, read access to the file is needed. 
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Activation of SDA 

$ ANALYZE/qualif ier 

What you use as a qualifer will determine what you will be 
examining . 

Table 4-3 Examining Crash Dump or Current System 



To Examine 



Qualifier 



Comment 



Current System 



/SYSTEM 



System Dump File /CRASH_DUMP 

or 

Other Dump File 



CMKRNL priv 
needed 

Read access to 
file needed 



SDA Functions 

• Examine locations by address or symbol 

• Displays process/system data 

• Formats and displays data-known data structures 

• Assigns values to symbols as requested. 



Command Format 

command [parameter] 



[/qualifier] 
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Table 4-4 SDA Functions and Commands 
Information 



Function 



Command 



Provides help using SDA 

Displays specific 
data/ information 

Format and display 
data structures 

Display contents of 
location (s) 



HELP 
SHOW 

FORMAT 

EXAMINE 



Manipulation 



Preserve second copy 
of dump file 

Create and define • symbols 

Perform computations 

Set/reset defaults 

Define other VMS symbols 

Repeat last command 



COPY 

DEFINE 

EVALUATE 

SET 

READ 

REPEAT 

or 

<ESC> 
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Table 4-5 SDA Commands Used to Display Information 



Function 



Command 



Comments 



The last crash SHOW CRASH 
I/O data structure SHOW DEVICE 

System page table SHOW PAGE TABLE 



PFN data base 



Dynamic pool 



Process specific 
information 



Stacks 



Summary of all 
processes 

Symbol table 



SHOW PFN DATA 



SHOW POOL 



SHOW PROCESS 



SHOW STACK 



SHOW SUMMARY 



SHOW SYMBOL 



Dump file only 

Device_name 

parameter 

optional 

/GLOBAL, /SYSTEM 
/ALL (D) 

/FREE, /MODIFIED 
/SYSTEM, /BAD 
/ALL (D) 

/IRP, /NONPAGED 
/PAGED, /SUMMARY, 
/ALL (D) 

/PCB (D) , /PHD 
/WORKING_SET, /ALL 
/REGISTERS, /PAGE_TABLES 
/PROCESS_SECTION_TABLE 

/INTERRUPT, /KERNEL 
/EXECUTIVE, /SUPER 
/USER 



Symbol-name parameter 
optional, /ALL 
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Table 4-6 Symbols and Operators 



Function 



Symbol or 
Operator 



Example 



Contents of location 

Add 80000000 (S0 base) 
to address 

Add 7FFE0000 (PI 
stacks) to address 

Current location 

Hexadecimal number 
radix 

Octal number radix 

Decimal number radix 

Register symbols 



§ 
G 

H 



'0 

•D 



R0-R11, AP, FP, 
KSP, ESP, SSP, USP, 
P0BR, POLR, P1BR, 
P1LR, PC, PSL 



Examine @8000045A 
G45A 

H7A4 

Format 
"H10 

"020 
"D16 



Table 4-7 Common Command Usage 



Function 



Command 



Comment 



Examine 
location (s) 



EX . 

EX G14:G74 



Examine address EX @USP 
at location 



Format data 



Define symbol 



Format addr 
Format @addr 

Define BEGIN = G580 



One location 
Several locations 

Examine address found 
contained in given 
location 

Format at given location 
Format at contents addr 
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Examining an Active System 

* analyze/systemO 

WAX/VMS System snslyser 



SDA> EVALUATE GH50*4)-(4/2H"Q7 '«'** 
He:-: = 80000145 Decimal = -2147483323 

SDA> EXAMINE G25C0 *^* 
SCH*GL_SWPPCB+05BJ 00000000 "..,.* 



Jb 



SDA> EXAMINE ' 

SCH$6L_SWPPCB+05C: 00000000 ■..♦.' 



SDA> $<ESC> 

sch*gC swppid: 00010001 



SDA> i<ESC> 

SCH*GL_SWPPID+004J 800023F0 ',#,. 



SDA> EX IQCfGL-BEVLIST 

ioc*gl_devlist: sooMcic "l..." 



SDA> EX RO 
ROJ 00000001 



SDA) EX PSL 

pel: O3C0OOOO ■.♦., 



SDA> EX G100;G140 

0004001B 8FBC00FC 0004001A 8FBC003C 
0004001B 8FBC07FC 0004001C 8FBC00FC 
0004001F 8FBC0FFC 0004001E 8FBC00FC 
00040021 8FBC003C 00040020 8FBC01FC 
00040023 8FBC01FC 00040022 8FBC0010 



********* 


* * * * * 


80000100 


********* 


****** 


80000110 


*>*.** * 4*41 


* » * * * 


80000120 


ft. f * * < ♦ 


,,!»,, 


80000130 


■ 

t * ♦ * * 1 * * 


..*... 


80000140 



Example 4-2 Examining an Active System (Sheet 1 of 5) 
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SDA; SHOW PROCESS **** 
Process sUtusJ 00040001 



RESfPHDRES 



PCB address 

Master PID 

PID 

PHD address 

State 

Current priority 

Base priority 

UIC 

Mute:-; count 

Waiting EF cluster 

Starting wait time 

Event flag wait mask 

Local EF cluster 

Local EF cluster 1 

Global cluster 2 pointe 

Global cluster 3 pointe 



800E78CO 

00050048 

00050048 

80149C00 

CUR 

9 

4 

tOllfllOD 





00001B1B 

F7FFFFFF 

CC000001 

00000000 

00000000 

00000000 



JIB a 
Creat 
Subpr 
Swapf 
Temii 
AST's 
AST's 
AST's 
Buffe 
Direc 
BUFIO 
* ope 
Timer 
Activ 
P roce 
Globa 



ddres 

or PI 

ocess 

ile d 

natio 

enab 

acti 

reina 

red I 

t 1/0 

byte 

n fil 

entr 

e F32 

ss US 

1 WS 



count 
isk address 
n mail bo:-, 
led 
ve 

lnins 
/0 count/1 ii* it 

count/ limit 

count/limit 
es allowed left 
ies allowed left 
e table count 

page count 
page count 



800E7780 
00000000 



01000421 

0000 



KESU 
NONE 

9 

6/6 
6/6 
8128/8192 
36 
10 

183 
12 



da> show pfn. data/modified Q 



Count! 
LolimitJ 
High limit? 



PFN 



PTE ADDRESS 



29 

140 

44 

BAK 



REFCHT FLINK BLINK 



TYPE 



STATE 



0199 
011F 
01 DO 
066F 
0297 
01E9 
01E7 
01E5 



8014CC84 
8014CAC8 
8O15F0D4 
8015F534 
8014C8B8 
8014C9FC 
8014CA04 
8014CA0C 



04000000 
04000000 
04000000 
04000000 
04000000 
04000000 
04000000 
04000000 














011F 
01DO 
066F 
0297 
01E9 
01E7 
01E5 
01E6 



0000 
0199 
01 IF 
01D0 
066F 
0297 
01E9 
01E7 



00 PROCESS 
00 PROCESS 
00 PROCESS 
00 PROCESS 
00 PROCESS 
00 PROCESS 
00 PROCESS 
00 PROCESS 



81 
81 
81 
81 
81 
81 
81 
81 



MDFYLST 
MDFYLST 
HDFYLST 
MDFYLST 
MDFYLST 
MDFYLST 
MDFYLST 
MDFYLST 



.TITLE GLOBALS 



$PHDDEF 
♦DPTDEF 
JIDBDEF 
*CRBDEF 
*ADPDEF 
tDDBDEF 
♦UCBDEF 
♦VCBDEF 
$ACBDEF 
JIRPDEF 

.END 



GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 
GLOBAL 



PROCESS HEADER 
DRIVER PROLOGUE TABLE 
INTERRUPT DATA BLOCK- 
CHANNEL REQUEST BLOCK 
ADAPTER CONTROL BLOCK 
DEVICE DATA BLOCK 
UNIT CONTROL BLOCK 
VOLUME CONTROL BLOCK 
AST CONTROL BLOCK 
I/O REQUEST PACKET 



Example 4-2 Examining an Active System (Sheet 2 of 5) 
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SI)A> READ CHELLER]GLOBALS< 



SDA> FORMAT eiOC*GL_BEVLIST#l 




80O0OC6C 


DDS*L_LINK w 


80000D9C 


80O0OC70 


DDBiL.UCB 


80000CA0 


80000C74 


DBB$W_SIZE 


0034 


80O0OC76 


DDB*B_TYPE 


06 


80O0OC77 




00 


80O0OC78 


DBB$L_DDT 


800B4AFC 


80000C7C 


BBB»L_ACPB 
DBB$B_ACPCLASS 


01313146 


80O0OC80 


DDB$T_NAME 


•DRA' 


80O0OC84 




00000000 


8OO0OC88 




00000000 


80000C8C 




00000000 


80O0OC90 


DBB$T_DRVNAME 


■DRDRIVER 1 


80000C99 




000000 


80O0OC9C 


DBB*C_LENGTH 


00000000 


SDA> FORMAT (?.© 




80000D9C 


DDB*L_LINK 


30000F84 


80000DAO 


BBB*L_UCB 


80000DD0 


80O0ODA4 


BDB$U_SIZE 


0034 


80O0ODA6 


DBB$B_TYF'E 


06 


80000DA7 




00 


80O0ODA8 


BDB*L_BDT 


800B29B3 


80O0ODAC 


DDB$L_ACPD 
DBB*B_ACPCLASS 


00000000 


8OO0ODB0 


DDB$T_NAME 


•OPA" 


80O0ODB4 




00000000 


80O0ODB8 




00000000 


80000BBC 




00000000 


80000DCO 


DBB$T_HRVNAME 


'OPERATOR* 


80000DC9 




000000 


80000DCC 


BDB$C_LENGTH 


00000000 


SDA> *<ESC>0 




8OO0OF84 


DBB*L_LINK 


80001144 


8OO0OF88 


DDB$L_UCB 


8000103C 


80O0OF8C 


DHB$W_SIZE 


0034 


80O0OF8E 


DDB$B-TYPE 


06 


8OO0OF8F 




00 


80O0OF90 


DDB«L_DDT 


800013E8 


80000F94 


HDB$L_ACP0 
DDB$B_ACPCLASS 


00000000 


8OO0OF98 


DDB$T_NAME 


■MBA' 


80000F9C 




00000000 


8OO0OFA0 




00000000 


80000FA4 




00000000 


8OO0OFA8 


DDB$T_DRVNAME 


■MBDRIVER' 


80O0OFB1 




000000 


8OO0OFB4 


DDB*C_LENGTH 


00000000 



SUA) 
Example 4-2 Examining an Active System (Sheet 3 of 5) 
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SDA> SHOW POOL/IRP 



Dump of blocks allocated from IRP lookaside list 



BUFIO 800BDA00 



160 



IRP 



800DE680 



160 



UCB 



800DF760 160 



PCB 



800DF800 160 



JIB 



80ODF8A0 160 



CRB 



800DFE40 



160 



00000000 0013009E 
80000CAO 800D203E 
801015C0 101BFF70 
00000000 00000001 
00000041 00000002 
0O0OO000 800E793C 
00000000 00000000 
00000000 00000000 
00000000 00000000 
00000000 00000000 

00010047 430A009C 
8000103C 00000000 
00000000 0403FFE0 
00000000 00000290 
8014CCF0 00000001 
30203635 800E1E9C 
80000000 00000000 
54534C59 46444D20 
800DE70C 00090048 
00000000 00000000 

800DF76C 081000A0 
00000000 00000000 
00000000 00010047 
40000082 00340143 
00000000 00000000 
00000000 00000010 
00000000 00000000 
00000000 800SC958 
00000000 OOOOOOOF 
00000000 00000000 

00000F00 180C00A0 
00000000 O00C4674 
18000007 00001817 
OOOCOOOC O00C003F 
F7FFFFFF 00000000 
00000000 00000000 
00544D46 52524506 
F3FFFDFF 800DF8AO 
800DF88C 00010006 
00000000 00000000 

00000000 002F0070 

00000000 00000000 

00004FB9 00005000 

0O0AO00A 00000000 

54535953 00000000 

00000000 00000000 

00000000 00000000 

00000000 00000000 

00000000 00000000 

00000000 00000000 



800E9440 
4144530A 
7FFB9A14 
00000000 
00000020 
OOOOOOOO 
00000000 

oooocooo 

00000000 
00000000 

80002790 
00000280 
00000288 
00000000 
00000200 
20203020 
00000000 
31382020 
800DE6FC 
00000000 

00000000 
00000000 
80106540 
08840043 
800DF7A0 
80000CAO 
00000000 
00000000 
OOOOFFFF 
00000000 

800E1E20 
800DF810 
00040001 
003B0000 
00000000 
00000000 
8011E0OO 
00000000 
300DF87C 
00000000 

00000000 
OOOOAOOO 
0040003F 
00400000 
00000000 
20202020 
00000000 
00000000 
00000000 
00000000 



800DDAAO , 
8002HB28 ( 
1B1B0034 4 
0005005D ] 
00000600 . 
00001041 A 
00000000 . 
00000000 ♦ 
00000000 . 
00000000 . 

800E6D80 . 
00002FEC . 
17000021 ! 
03200000 . 
00000000 . 
000010CA , 
FFFFFFFF . 
20202053 3 
OOOOOOOD . 
800DE70C . 

00000000 . 

800DF76C 1 

801065A0 , 

8O0E64C0 

800DF7A0 

03140001 

00000001 

00000000 

00000000 

00000000 



.sba: 



,d. 



800E7D20 
800DF810 
01000181 
00000000 
OOOOOOOC 
4C0OOO0O 
0002004A 

oooooooo 

FFFFFFFF 
800DF88C 

OOOOOOOO 
00009FCO 
0040003F 
OOOOOOOO 
0002004A 
20204D45 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 
OOOOOOOO 



>. 



J 

EM 



00000008 42050070 800DFE40 800DFE40 
001F0000 OOOOOOOO OOOOOOOO OOOOOOOO 

nA< Avfrrt r»A/\nrt-ir*tr rr a r -i r r» r. aaaaaaaa 



,L, 



♦ CG. 

♦ ♦ : *. ♦ 

♦ * 4 * 
4 t # 4 

♦ 4 * * 

..56 

♦ • * « 

MDFYLS 

4*44 

♦ 444 

♦ t 1 * 

♦ 4 4 4 
4 * ♦ t 

♦ * f » 
4 * » * 
4 4 4 4 
4 4 * 4 
4 4*4 
I * I * 
f 4 4 4 



F.... 

# * 4 ♦ 

♦ * 4 * 
4 « 4 • 

ERRFMT 

» 4 4 * 
4 4*4 

» • * » 



4 4 + 4 

...0 

4 4 4 4 

.♦SY 

4*44 
4*4* 
4 4 4 4 
4*44 
4 4 4 4 

* B 4 4 

* 4 4 4 



Example 4-2 Examining an Active System (Sheet 4 of 5) 
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SDA> SHOU STACK/USER 

Current operating stsek (USER)' 



SP => 



7FFB624C 
7FFB6250 
7FFB6254 
7FFB6258 
7FFB625C 
7FFB6260 
7FFB6264 
7FFB6268 

7FFB626C 
7FFB6270 
7FFB6274 
7FFB6278 
7FFB627C 
7FFB6280 
7FFB6284 
7FFB6288 
7FFB628C 
7FFB6290 
7FFB6294 
7FFB6293 
7FFB629C 
7FFB62A0 
7FFB62A4 
7FFB62A8 
7FFBA2AC 
7FFB62B0 
7FFB62B4 
7FFB62B8 
7FFB62BC 
7FFB62C0 
7FF862C4 
7FFB62C8 
7FFB62CC 
7FFB62D0 
7FFB62D4 
7FFB62B8 
7FFB62DC 
7FFB42E0 
7FFB62E4 
7FFB62E8 
7FFB62EC 
7FFB62F0 
7FFB62F4 
7FFB62F8 
7FFB62FC 
7FFB6300 
7FFB6304 
7FFB6308 
7FFB630C 
7FFB6310 
7FFB6314 
7FFB6318 
7FFB631C 
7FFB6320 
7FFB6324 
7FFB6328 
7FFB632C 
7FFB6330 
7FFB6334 
7FFB6338 
7FFB633C 
7FFB6340 
7FFBA314 



000125E8 
O00011CO 
00012C04 
00000000 
00000010 
7FFB62E0 
7FFB62E0 
7FFB626C 

OOOOOOOi 
7FFB6270 
00000000 
200C0000 
000011C0 
7FFBA2F0 
0001161E 
00000000 
000125E8 
00000003 
7FFB6800 
7FFB6800 
7FFB626C 
00000000 
8011HA00 
00000400 
000114AA 
7FFEAE00 
7FFEAEO0 
00000600 
0001 14B4 
7FFEBE00 
7FFEBE00 
00001000 
000114BB 
7FFEH56C 
7FFEDE00 
00002000 
000114C5 
7FFB426C 
7FFB6800 
7FFB6800 
0001 14B0 
00000000 
07FC0000 
7FFB636C 
7FFB6330 
00036C8E 
00000000 
000125E8 
000011CO 
00012C04 
00000000 
000011CC 
000125E4 
000011D4 
000011F7 
00000000 
00000000 
00000000 
2FFCO000 
7FFB63AC 
7FFB6390 
00002DCA 



SGN$C_MAXPGFL+1C0 



SGN*C_MAXPGFL+1C0 



BUG$.UNEXUBAINT 

CTL$GL_KSPINI 
CTL$GL_KSPINI 
SUP$AL_PTRPAD 



SGN$C_MAXPGFL 



SYS*GI0kl 
SGN$C_MAXVPGCNT 



SGN$C_KAXPGFL+1C0 



SGNtC_MAXPGFL+lCC 

SGN$C_MAXPGFL+1D4 
SGN$C_MAXPGFL+1F7 



SS$_EXENQLM+396 
ss* FvriFPTH+inr 



Example 4-2 Examining an Active System (Sheet 5 of 5) 
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DEBUGGING TOOLS 



Examining a Crash Dump File 

* ANALYZE/CRASH.DUMP SYSfSYSTEMJSYSDUMP.DMP 
VAX/VMS System dump analyser 

Du*p taken on 7-JUN-1982 i7515{54.12 

INVEXCEPTN* Exception while above ASTDEL or on interrupt stack 

SDA> SHOW CRASH 

Tine of saste* crash? 7-JUN-1982 17215:54.12 

Version of system: MAX/VMS VERSION V3.0 

Reason for BUGCHECK exception.* INMEXCEPTN> Exception while above ASTDEL or on interr 

Process currently executing: NULL 

Current IPL: 31 (decimal) 



General reaistersJ 



RO 


= 0000001F 


Rl 


= 


001F0000 


R2 = 


00000000 


R4 


= 00000000 


R5 


= 


00000000 


R6 = 


00000000 


R8 


= 00000000 


R9 


= 


00000000 


R10 = 


00000000 


AP 


= 00000000 


FP 


= 


00000000 


SP = 


800009A0 



PSL = 001FO009 



R3 = 00000000 

R7 = 00000000 

Rll = 00000000 

PC = 80003DC6 



Processor registers: 



SDA> 



POBR 


s: 


80000000 


PCBB 


0012184C 


ACCS 


= 00000000 


POLR 


s 


00000000 


SCBB 


0016FEOO 


TBDR 


= 00000000 


P1BR 


ir 


7F802000 


ASTLVL = 


00000004 


CADR 


= 00000000 


P1LR 


= 


00200000 


SISR 


00000000 


MCESR 


= 00000000 


SBR 


= 


00171AOO 


ICCS 


800000C1 


CAER 


= 00000000 


SLR 


= 


00003980 


ICR 
TODR 


FFFFF9DE 
61392F29 


CMIERR 


= 00080010 


ISP 


= 


8011DA00 










KSP 


- 


800009AO 










ESP 


— 


00000000 










SSP 


= 


00000000 










USP 


= 


00000000 











Example 4-3 Examining a Crash Dump File 
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DEBUGGING TOOLS 



DELTA AND XDELTA 



Table 4-8 Comparison of DELTA with XDELTA 



FACTORS 



DELTA 



XDELTA 



Usage 



IPL 



User images 



Terminal used Any TTY 
for control 



= 



Operating System Drivers 
Console only (OPA0:) 

>0 



How activated Linked or included Included at boot time 

at run time 



Access mode 



All modes 



Kernel mode only 



Both debuggers are: 



• Non-symbolic 

• Use name command syntax 

• No visible prompt 

• Error message is "Eh?". 
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DELTA Debugger 

To use the DELTA debugger, assemble and link a program in the 
following fashion. 

1. $ MACRO prog_name+SYS$LIBRARY: LIB/LIB 

2. $ LINK/DEBUG prog_name, SYS$SYSTEM: SYS. STB/SELECT 

3. $ DEFINE LIB$DEBUG DELTA 

4. $ RUN prog_name 

Steps : 

1. Assembles the program allowing system macros to be defined 
(SYS$LIBRARY: LIB/LIB) . 

2. Links the program with a debugger and resolving any system 
symbols (SYS$SYSTEM:SYS. STB) . 

3. Define the debugger used to be DELTA. 

4. Activate the program mapping in DELTA. 
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CHMK Program 

It is often convenient to observe data structures changing 
dynamically. One way to gain access to kernel mode data 
structures is to run the CHMK program. This program allows any 
privileged process (with CMKRNL privilege) to change mode to 
kernel, and enter DELTA commands (e.g., to look at system data 
structures) . Extreme caution should be exercised so that data 
structures are not modified, since such modification could lead to 
a system crash. 

Perform the following steps to use the CHMK program. 

1. Assemble CHMK. 

2. Link CHMK. 

3. Indicate the DELTA debugger. 

4. Run the CHMK program. 

5. Enter a breakpoint in the program and tell it to proceed. 

The Corresponding Commands are: 

1. $ MACRO CHMK + SYS$LIBRARY: LIB/LIB 

2. $ LINK/DEBUG CHMK, SYS$SYSTEM: SYS. STB/SELECT 

3. $ DEFINE LIB$DEBUG DELTA 

4. $ RUN CHMK 

5. 215;B;P 

Note that at step 4, no prompt from DELTA is given. 

After you receive the "stopped at breakpoint" message, you 
are in kernel mode, and may proceed to examine system data 
structures. To leave the program, type ';P', followed by EXIT. 
(If you just type EXIT, you will be logged off, since kernel mode 
exit implies process deletion.) 
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GO: .WORD ; NULL ENTRY MASK 

$CMKRNL_S RQUTIN = 10$ ; ENTER KERNEL HOOE 
RET ; ALL DONE 

10$: .word o ; null entry mask 

nop ; WHERE bpt instruction 

nop ; is placed, by 215;b 

; ISSUED BY USER 

MOVZBL *SS$_NOR»1AL,R0 ; return success status 
ret ; all done 

.end go 

Example 4-4 The CHMK Program, Run with DELTA 
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DEBUGGING TOOLS 



DELTA and XDELTA Functions and Commands 



Table 4-9 DELTA and XDELTA Functions and Commands 



Function 



Command 



Example 



Display contents 
of given address 

Replace contents 
of given address 



Display contents 
of previous 
location 



address/ 
addr/contents new 



<ESC> 



GA88/00060034 



GA88/00060034 GA88 

GA88/00060034 'A' 
(Replace as ASCII) 

80000A88/80000BE4 <ESC> 
80000A84/00000000 



Display contents 
of next location 

Display range of 
locations 



Display indirect 



Single step 
command 



Set breakpoint 



Display breakpoint 



addr/contents <LF> 
addr '/contents 

addr ,addr '/contents 



<TAB> 

or 

/ 



addr;N;B <RET> 

(N is a number 2-8) 

;B 



80000004/8FBC0FFC 
80000005/50E9002C 

G4,GC/8FBC0FFC 

80000008/50E9002C 

8000000C/00000400 

80000A88/80000BE4 <TAB> 
80000BE4/80000078 

8 0000A88/8 0000BE4/800000' 

1 brk at 8000B17D 

S 

8000B17E/9A0FBB05 

800055F6;2;B 



;B 

1 8000B17D 

2 800055F6 
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Table 4-9 DELTA and XDELTA Functions and Commands (Cont) 



Function 


Command 


Example 


Clear 


0;N;B <RET> 


0;2;B 


breakpoint 






Proceed from 


;P 


;P 


breakpoint 






Set base 


•value' ,N,X 


80000000, 0,X 


register 






Display base 


Xn <RET> 


X0 


register 


or 


00000003 




Xn= 


X0=00000003 


Display general 


Rn/ 


R0/00000003 


register 


(n is in 
Hexadecimal) 





Show value 



expression= 



l+2+3+4=0000000A 
(+,-,*, %{divide} ) 



Executing stored 
command strings 

Change display 
mode 



addr;E <ret> 



[B 
[W 
[L 



[" 



80000E58;E 



Byte width 
Word width 
Longword width 
ASCII display 
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DEBUGGING TOOLS 



CONSOLE COMMANDS 

Table 4-10 Console Commands 

Function Command* 

Look at Examine 

Physical memory 
General and processor registers 

Place information into Deposit 

Physical memory 
General and processor registers 

Put processor into known state Initialize 

Stop the CPU (necessary for 780 only) Halt 

Restart halted CPU Continue 

Execute one instruction at a time Single step 



* Exact form of command is CPU-specific. Consult the 
VAX Hardware Handbook. 
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PATCH 

The patch utility enables a user to 'edit* an image file. 

Patch is intended to be used on non-DIGITAL software. Application 

of patches to DIGITAL software, other than those that are DIGITAL 
supplied, invalidate the warranty. 

Table 4-11 PATCH Commands 

Function Command 

Display contents of one Examine 

or more locations 

Store new contents in Deposit 

one or more locations 

Insert one or more Insert 

symbolic instructions 

Verify the replace Replace 

contents of location 

Display various SHOW parameter 

information (e.g., 
module names) 

Alter default settings SET parameter 

(e.g., module name 

referenced) 
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C 



APPENDIX 

BUGCHECK FLOW OF CONTROL 



SYSTEM 

COMPONENT 

INVOKES 

BUG_CHECK. 

GENERATES 

EXCEPTION 



I 



SYSTEM 
DISPATCHES 
(THROUGH SCB) 
TO 
EXE$OPCDEC 




HANDLE IN 

TRADITIONAL 

WAY 

(EXCEPTION 

DISPATCHER, 

ETC.) 



JUMP TO 
EXE$BUG_CHECK 



) 



TK-9009 



Figure 4-5 Bugcheck Flow of Control (Sheet 1 of 3) 
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c 



EXE$BUG_CHECK 



) 



YES 



READ 

BUG$_XXXX 
CODE 

FOLLOWING 
FF, FEOR FF,FD 



READ FATAL 

BUG 

CODE FROM 

SYS.EXE 




$EXIT_S - 
#SS$_BUGCHECK 




WRITE 
ERROR LOG 
ENTRY 



RETURN 
(RED 



) 



(JUMP TO "\ 
BjJG$FATAL/ 



Figure 4-5 Bugcheck Flow of Control (Sheet 2 of 3) 
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f bug$fatal J 



PRINT 
INFO 
ON 
CONSOLE 



WRITE 
DUMPFILE 



BUILD 

DUMPFILE 

HEADER 




YES, 




.YES 




HALT 



CALL 

X DELTA 

(BREAKPOINT) 



PRINT 
SHUTDOWN 
MESSAGE ON 
CONSOLE 



LOOP 
FOREVER 



Figure 4-5 Bugcheck Flow of Control (Sheet 3 of 3) 
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SAMPLE CRASH DUMP ANALYSIS 



* ANALYZE/CRASH SYS$SYSTEMJSYSDUHP.DMP 
VAX/VMS System duaip analyzer 

Du*p taken on 10-JUN-1982 12J54S02.76 
SSRVEXCEPT> Unexpected saste* service exception 

SDA> SHOW STACK 

Current operating stack (KERNEL)! 



SP => 



7FFEAD53 
7FFEAD5C 
7FFEAD60 
7FFEAD64 
7FFEAD68 
7FFEAD6C 
7FFEAD70 
7FFEAD74 

7FFEAD78 
7FFEAD7C 
7FFEAD80 
7FFEAD84 
7FFEAD88 
7FFEAD8C 
7FFEAB90 
7FFEAD94 
7FFEAD98 
7FFEAD9C 
7FFEADA0 
7FFEADA4 
7FFEADA8 
7FFEABAC 
7FFEABB0 
7FFEADB4 
7FFEADB8 
7FFEADBC 
7FFEADC0 
7FFEADC4 
7FFEAHC8 
7FFEADCC 
7FFEADD0 
7FFEABD4 
7FFEADD8 
7FFEADDC 
7FFEABE0 
7FFEADE4 
7FFEADE8 
7FFEADEC 
7FFEADF0 
7FFEADF4 
7FFEADF8 
7FFEADFC 



7FFED778 
7FFEDDD4 
7FFE7C90 
7FFEAD90 
7FFEAD78 
7FFEAD70 
8000CFF0 
00000000 

00000000 
00000000 
00000000 
7FFEAHD0 
80000014 
800130D1 A 

00000002© 
7FFEADB4,T 

7FFEAD9C © 

00000004 w 

7FFB6360 

FFFFFFFD 

00COO0O9 

00000002 

000008F8 A 

00000005© 

oooooooc^ 

00000000 

0000000c A 

80008BE8© 

OOC00004 W 

0000021D 

00000000 

00000000 

7FFB6378 

7FFEADE4 

80008089 

00000000 

00000000 

7FFB6378 

7FFB6360 

8000CFE6 

7FFEDE96 

03COOOOO 



CTL*A6_CLIDATA+080 
CTL$GL_KSTKBAS+590 
CTL*GL_KSTKBAS+578 
CTL*GL_KSTKBAS+570 
EXE$EXCPTN+O0c 



CTL$GL_KSTKBAS+5B0 
SYS$CALL_HAN0L+004 
EXE$SRCHANBLER+0C5 

CTL*GL_KSTKBAS+5B4 
CTL$GL_KSTKBAS459C 



VA$M_MPG+1FB 
PSL$M_PRV«0B+009 

SS$_END0FFILE+088 



HPHtQAST 

PSL*M_PRVriOD+004 

FIL*C-SIZE+005 



CTL*GL_KSTKBAS+5E4 
EXE$CMKRNL+00D 



EXE*CM0DEXEC+18E 
SYS$CMKRNL+006 



Example 4-5 Sample Crash Dump Analysis (Sheet 1 of 4) 
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S1AF 
01AF 
*1AF 
«1AF 
31 AF 
01AF 
01AF 
*1AF 
01AF 
01AF 
01AF 

eiAF 

MAF 
01AF 
5UAF 
01AF 
91AF 
91AF 
0tAF 
01AF 
01AF 
01AF 
*1AF 

eiAF 

"?tAF 

eiAF 

01AF 
01AF 
01AF 

aiAF 

P1AF 

01AF 
01AF 
tflAF 
»UF 
01AF 
01AF 

eiAF 

0182 
01B5 
81BA 
«1BC 
81BC 
SUBC 



455 
456 
457 
458 
459 
460 
461 
462 
463 
464 
465 
466 
467 
166 
469 
470 
471 
472 
473 
474 
475 
476 
477 
478 
479 
480 
481 
482 
«83 
484 
485 
486 
487 
488 
489 
490 
491 
492 
493 
494 
495 
496 
497 
498 



>♦♦ 



.SBTTl SCHSQAST - ENQUEUE AST CONTROL BLOCK FOR P 



1BCO 499 
61C0 500 
01C6 501 
91CC 502 
P1D1 533 
S103 5P4 



FUNCTIONAL DESCRIPTION! 

SCHSQAST INSERTS THE AST CONTROL BLOCK SUPPLIED IN 
POSITION BY ACCESS MODE IN THE AST QUEUE OF THE PR 
BY THE PID FIELD OF THE AST CONTROL BLOCK. AN AST 
IS THEN REPORTED FOR THE PROCESS TO REACTIVATE FRO 
IF APPROPRIATE. THE AST CONTROL BLOCK HILL BE REL 
IF THE PID SPECIFIES A NON-EXISTENT PROCESS. 

LOADABLE MULTI-PROCESSING CODE WILL REPLACE THIS R 
ENTIRELY NEW CODE, AT MPHSQAST. 

CALLING SEQUENCE! 

BSB/JSB SCHSQAST 

INPUT PARAMETERS! 

P2 - PRIORITY INCREMENT CLASS 

R5 - POINTER TO AST CONTROL BLOCK 

IMPLICIT INPUTS! 

PCB OF PROCESS IDENTIFIED BY PID FIELD 

OUTPUT PARAMETERS! 

RPI - COMPLETION STATUS CODE 

R4 - PCB ADDRESS OF PROCESS FOR WHICH AST WA8 QUEL 

SIDE EFFECTS! 

THE PROCESS IDENTIFIED BY THE PID IN THE AST CONTP 
WILL BE MADE EXECUTABLE IF NOT SUSPENDED. 



COMPLETION CODES! 

SSS^NORMAL • 
SSSJylONEXPR - 



NORMAL SUCCESSFUL COMPLETION STATUS 
NON-EXISTENT PROCESS 



.ENA8L 
QNONEXPRl 

MOVL 
BSB* 
MOVZWL 
BRB 

MPHSQASTll 

SCHSQASTll 

0MOVZWL 
DSBINT 
MOVL 
CMPL 
BNEQ 
CLRL 



LSB 



R5,R0 

EXESDEANONPAGED 
#SS$.,.NONEXPR,R0 
QEXIT 



ACB$L A PID(R5)#R0 

#IPL$ A SYNCH 

• W'SCHSGLa.PCBVECtRBliR* 

ACBSLjPIDCRSJfPCBSL 

QNONEXPR 

R0 



RELEASE AST CON1 
IF NO SUCH PROCE 
SET ERROR STATU! 
AND EXIT 



J MULTI-PROCESSINC 
; ENQUEUE AST FOR 
; GET PROCESS INDE 
I DISABLE SYSTEM f 
I LOOK UP PCB ADDF 
PID(R4) f CHECK FOR Mrf 
? PID MISMATCHES 
I ASSUME KERNEL MC 



Example 4-5 Sample Crash Dump Analysis (Sheet 3 of 4) 
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SDA> SHOW CRASH _ „, 

Time of system crash! 10-JUN-1982 i2:54t02.76 

Version of system: VAX/VMS VERSION V3.0 

Reason for BUGCHECK exception J SSRVEXCEF'T* Unexpected system service exception 

Process currently executing} _0PA0J 

Current imase file name! DRAOJCHELLERIICRASHAST.EXEJl 

Current IPLt (decimal) 



General resistersJ 



RO 


r 


00000000 


Rl 


R4 


s 


800E53E0 


R5 


R8 


= 


7FFED570 


R? 


AP 


= 


7FFEAD90 


FP 



PSL = 00000000 



8000CFEA — k R2 = 00000004 R3 = 7FFC4B3B 

00000000© R<S = 31000408 R7 = 7FFED988 

7FFEB778 R10 = 7FFEDDD4 Rll = 7FFE7C90 

7FFEAD78 SP = 7FFEAB78 PC = 8000CFF0 



Processor registers? 



SDA> 



POBR 


= 


801A3800 


PCBB 


= 0004A874 


ACCS 


= 00000000 


POLR 


= 


00000003 


SCBB 


= 0016FE00 


TBBR 


= 00000000 


P1BR 


- 


7F9B7200 


ASTLVL 


= 00000004 


CADR 


= 00000000 


P1LR 


- 


001FFB9E 


SISR 


= 00000000 


MCESR 


= 00000000 


SBR 


= 


00171AOO 


ICCS 


= 800000C1 


CAER 


= 00000000 


SLR 


= 


00003980 


ICR 
TOBR 


= FFFFFBAA 
= 62AC9BEC 


CMIERR 


* 00080010 


ISP 


- 


8011DA00 










KSP 


= 


7FFEAB78 










ESP 


= 


7FFEBE00 










SSP 


= 


7FFED56C 










USP 


= 


7FFB6360 











Example 4-5 Sample Crash Dump Analysis (Sheet 4 of 4) 
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SCHEDULING 



INTRODUCTION 

Scheduling is the selection of a process for a particular 
action or event. The scheduler, a software interrupt service 
routine at IPL 3, is responsible for selecting which 
memory-resident, executable process will be the next one to 
control the CPU. The scheduler code performs the exchange of 
hardware process contexts between the set of resident, computable 
processes and the currently executing process. 

Two portions of the swapper, a system process, select 
candidates for removal from, or placement in, the set of 
memory-resident processes (the balance set). Outswap operations 
move processes in memory-resident states to corresponding 
outswapped states. Inswap operations transform executable, 
nonresident processes into executable, resident ones. 

Additional support routines provide the logic to establish 
and satisfy a range of conditions for which processes may wait. 
Examples of these conditions include system service requests (such 
as $HIBER, $RESUME, or $WAITFR) and resource waits (such as mutex 
wait or depleted system dynamic memory) . 



OBJECTIVES 

1. For each process state, describe the properties of a 
process in the state, and how a process enters and leaves 
the state. 

2. Given a set of initial conditions and a description of a 
system event, describe the operation of the scheduler. 

3. Assign priorities for a multiprocess application. 

4. Discuss the effects of altering SYSGEN parameters related 
to scheduling. 
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RESOURCES 



Reading 

• VAX/VMS Internals and Data Structures Manual , chapters on 
scheduling and swap scheduling. 

Additional Suggested Reading 

• VAX/VMS Unternals and Data Structures Manual , chapters on 
software interrupts, process control and communication, 
timer support, and synchronization techniques. 



Source Modules 

Facility Name 
SYS 



Module Name 

SCHED 

RSE 

SYSWAIT 

SDAT 

SWAPPER (local 

label SWAPSCHED) 

OSWPSCHED 

SYSPCNTRL 
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SCHEDULING 

TOPICS 

I. Process States 

A. What they are (current, computable, wait) 

B. How they are defined 

C. How they are related 

II. How Process States Are Implemented in Data Structures 

A. Queues 

B. Process data structures 

III. Operating System Code that Implements Process State Changes 

A. Context switch (SCHED.MAR) 

B. Result of system event (RSE.MAR) 
IV. Steps at Quantum End 

A. Automatic working set adjustment 
V. Boosting software Priority of Normal Processes. 
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PROCESS STATES 



DELETE 




Figure 5-1 Process State Diagram 

CURRENT - executing 

Q WAIT - removed from execution to wait for event completion 

O COMPUTABLE - ready to execute 

O WAIT OUTSWAPPED 

O COMPUTABLE OUTSWAPPED 
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PROCESS WAIT STATE DIAGRAM 




J COMO I <■ CRE/ 



Figure 5-2 Process Wait State Diagram 
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WAYS TO LEAVE CURRENT STATE 




10 

DELETE <■ 1 CUR 



.[ COM J 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 
10. 



Figure 5-3 Ways to Leave Current State 

Wait for common event f lag (s) set ($WAITFR) 

Wait for local event flag (s) set ($WAITFR) 

Hibernate until wake-up ($HIBER) 

Suspended until resume ($SUSPND) 

Removed from execution-quantum end or preempted 

Page read in progress 

Wait for free page available 

Wait for shared page to be read in by another process 

Wait for miscellaneous resources or mutex 

Deletion . 
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WAYS TO BECOME COMPUTABLE (INSWAPPED) 




10 



"t COMO 1 



Figure 5-4 Ways to Become Computable (Inswapped) 



1. Common event flag (s) set 

2. Local event flag(s) set 

3. Wake -up ($WAKE) 

4. Resume ($RESUME) 

5. Removed from execution-quantum end or preempt 

6. Page read complete 

7. Free page available 

8. Shared page read complete 

9. Miscellaneous resources available or mutex available 
10. Outswapped computable process is inswapped 
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INSWAPPED TO OUTSWAPPED TRANSITIONS 

f CEF V— i— ^^i— — — i ^ — — . |» [ CEFO 

0. 

f HIB V— — — — — ^ ^ ^ — i — » ( HIBO J 

( SUSP V- — - — — — — — ^ — — |»i f SUSPO) 

( COM J 

( PFW W — — ^ — — t ^ ^ ^ — — — ^-f PFWO J 

f FPG I— _ ■^^^^^___ _g»J F p G o J 
(cOLPGJ— — — > — — — . ^ ^ ^ ^ » ICOLPGQj 
(mWAItV— —. — — —. — ^ ^ — — » (MWAlTOi 

Figure 5-5 Inswapped to Outswapped Transitions 
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WAYS TO BECOME COMPUTABLE (OUTSWAPPED) 




■CREATE 



Figure 5-6 Ways to Become Computable (Outswapped) 
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QUEUES 



Information in a table: 



LIST- 



73 



280 



Information in a queue: 



LIST 

































^^ 
























73 


280 


-5 



In General, 

POINTER 









M P YT *- 




























-•PREVIOUS 


"•PREVIOUS 


^•PREVIOUS 




"LISTHEAD" 


DATA 


DATA 


DATA 



Figure 5-7 Queues 
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IMPLEMENTATION OF STATES BY QUEUES 



Pointer 



state 
"listhead" 




Figure 5-8 A State Implemented in Queues 



INSQUE Instruction 

The INSQUE instruction changes forward and backward links so 
that data structure (here the PCB) is inserted in a queue. For 
example, when a process is removed from execution by the 
scheduler, its PCB is inserted on a COM queue. 

REMQUE Instruction 

The REMQUE instruction changes forward and backward links so 
that data structure is removed from a queue. For example, when a 
process becomes current, its PCB is removed from a COM queue. 



182 



SCHEDULING 



Implementation of COM and COMO States 



BITMAP (1 EACH FOR COM, COMO) 

FOR STATE COM 
BITS 31 



PRIORITIES 

LISTHEADS (32 EACH FOR COM, COMO) 



QUEUE 

PRIORITY 31 

1 

30 



00 



LONGWORD QUEUE BIT MAP 
::SCH$GL.COMQS 



31 



QUEUE HEADERS 



:SCH$AQ_COMH 
:SCH$AQ_COMT 




Figure 5-9 Implementation of COM and COMO States 



Each bit and listhead corresponds to a scheduling queue at a 
particular software priority level. Figure 5-10 shows an example 
of this for computable processes at priority levels 4 and 6. 



BITS 31 



PRIORITIES 



QUEUE 25 
PRIORITY 6 











1 




1 










































I 









31 




Figure 5-10 Example of Computable Queues 
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Implementation of Wait States 



( 








• 




State 


Count 



Figure 5-11 Wait State Listhead 



The listhead for a wait state contains forward and backward 
links, a count of the PCBs in the wait queue, and an integer value 
corresponding to the wait state. Figure 5-12 shows what two 
processes in hibernate state would look like. 



































HIBER 


2 
















HIBER 




HIBER 













HIBERNATE 
LISTHEAD 



PCB 



PCB 



TK-8952 



Figure 5-12 Implementation of Wait States 
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Implementation of CEF State 



SCH$GQ_CEBHD:: 





CEB 
























Wait Queue 




— *■ 


PCB 


V 


PCB 


7 — + 


PCB 










CEB Name 


CEB 










1 ► 










Wait Queue 


T— ► 


PCB 












CEB 




















Wait Queue 


7 — ► 


PCB 


7 — *■ 


PCB 


















CEB 


















Wait Queue 











Figure 5-13 Implementation of CEF State 



When a common event flag cluster is created, a data structure 
contains both the cluster and listhead for the PCBs of processes 
waiting for event flags within the cluster. Therefore, there are 
as many CEF state queues as there are clusters. 
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SCHEDULING FIELDS IN SOFTWARE PCB 



SQFL 



SOBL 



PRI 



PHYPCB 



STS 



PRIB 



STATE 



Figure 5-14 Scheduling Fields in Software PCB 

SQFL, SQBL - state queue forward, backward links, link PCBs in a 
given state 

STATE - process state 

PRI - current software priority 

PRIB - base software priority 

PHYPCB - physical address of hardware PCB 

STS - process Status 
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SAVING AND RESTORING CPU REGISTERS 



PR$_PCBB 



STACK POINTERS 
KESU 



General Purpose 
Registers RO-R11 



AP 



FP 



PC 



PSL 



POBR 



AST LVL 



POLR 



P1BR 



P1LR 



Figure 5-15 Saving and Restoring CPU Registers 



Process-specific CPU registers are saved to/restored from 
hardware PCB during context switch (state change current < — > 
computable) . 

SVPCTX - copies stack pointers, general purpose registers, 
argument pointer, frame pointer, PC, and PSL to current process 
hardware PCB, then switches to system-wide interrupt stack. 

LDPCTX - restores stack pointers, general purpose registers, RP, 
FP, AST LVL, P0LR, R0BR, P1LR, P1BR from hardware PCB pointed by 
by PR$_PCBB. Pushes saved PC and PSL on stack, since REI which 
follows" pops them. 
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SCHEDULER (SCHED.MAR) 



1 

2 

3 

A 
e 

6 

7 

9 
1C 
11 
12 

13 

14 
1« 
1« 

17 
1$ 
IS 

20 
21 
22 
23 
2* 
25 
2€ 
27 
2* 
2S 
3C 
?1 
32 
33 
3* 
35 
36 
37 
38 
39 
4t 
41 
42 
4: 
*« 
45 
46 
47 
4€ 
4S 
5C 
51 
52 
52 
5* 



SCH$RESCHED 



RESCHEDULING INTERRUPT HANDLER 



environment: 

ipl=3 mooe=kernel is=0 
input: 

oocsp)=pc at reschedule interrupt 

04<sp)=psl at interrupt. 



.ALIGN 

mph$resched: 
sch$rescheo: 

SETIPL 
SVPCTX ( 
MOVL 
M0VZ3L 
BBSS 

10$: 

MOVAQ 
INSQUE 

;♦ 

: SCH$SCHED 

HPH$SCHED:: 
SCH$sched:: 

SETIPL 
FFS 

3EQL 

MOVAQ 

REMQUE 

avs 

8NEQ 
BBCC 

20$: 

CMPB 

3NE0 

MOVW 

MOVL 

CMPB 

BEQL 

BBC 

INCB 

30$: 

MTPR 

LDPCTX 

REI 

schsidle: 

SETIPL 

MDVB 
8RB 

qempty: 

.END 



LONG 



Ob 



#IPL$_SYNCH 

»c 

W A SCH*GL_CURPCB,R1 

PCB$B_PRICRl)tR2 

R2.W A SCH$GL_COMQS,10$ 

MOVW *SCH$C_C0M,PCB$W_STATE(R1) 

W*SCH$AQ_C0MTCR2 3,R3 

CR15,aCR3)+ Qd 

- SCHEDULE NEW PROCESS FOR EXECUTION 



#IPL$_STNCH 0b 

#0 t *32,k A SCH$GL_C0MQS,R2 

SCH$IOLE 

W*SCH$AQ_C0MHCR2 3,R3 

3CR3)+,R4 A c 

QEMPTY 

20$ 

R2,W A SCH$GL_COMQS,20$ 

#DYN$C_PCB,PCB$B_TYPECR4) 

QEMPTY 

#SCH$C_CUR,PCB$W_STATE(R4) 

R4,W*SCH$GL_CURPCB 

PCB$B_PRIBCR4),PCB$B_PRI(R4) 

30$ 

#4,PCB$B_PRICR4>,30$ 

PCB$B_PRICR4) 

MOVB PC8$B_PRICR4),W A SCH$GB_PRI 

PC8$L PHYPCBCR4),#PR$ PCBB 

^0d 



#IPL$_SCHED 

#32,W A SCH$GB_PRI 

SCH$SCHEO 

BUG_CHECK QUEUEMPTY, FATAL 



Example 5-1 Scheduler (SCHED.MAR) 
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Comments on SCHED.MAR: 

1. Current process > computable resident 

a. Entry point 

b. Synchronize access to scheduler data base 

c. Save hardware context of current process in hardware 
PCB 

d. Insert PCB at tail of COM queue 

2. Highest priority computable resident process > current 

a. Entry point 

b. Synchronize access to scheduler data base 

c. Remove PCB from head of COM queue 

d. Restore hardware context, push PC and PSL onto stack 

e. Transfer control to current process. 
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SOFTWARE PRIORITIES AND PRIORITY ADJUSTMENTS 



20 

18 

16 

14 
SOFTWARE 
PRIORITY 12 
LEVELS 



QUANTUM 
I 1 



CD 



m 



12 
10 

8 
6 


® 

-^ LT? 


£ 


r~ri ® [~b~i 


O 

B 




® 

|null 


(a) w 


4 


J A A 


2 







AAA 


AA 


A^k4« £fe tf!i ilk tt% itS 4Ph t 





TIME ► 



Figure 5-16 Software Priorities and Priority Adjustments 



190 



SCHEDULING 



Notes on Software Priorities and Priority Adjustments: 

Process • C becomes computable. Process 'A 1 is preempted. 
O ' c ' hibernates. 'A 1 executes again, one priority level 

Q 'A' experiences quantum end and is rescheduled at its base 
priority. 'B' is computable outswapped. 

The swapper process executes to inswap 'B'. 'B' is 
scheduled for execution. 

'B' is preempted by ' C ' . 

'B' executes again, one priority level lower. 

'B' requests an I/O operation (not terminal I/O). 'A' 
executes at its base priority. 

'A' requests a terminal output operation. The null 
process executes. 

'A' executes following I/O completion at its base priority 
plus 3. (The applied boost was 4.) 

'A' is preempted by 'C. 

'A' executes again, one priority level lower. 

'A' experiences quantum end and is rescheduled at one 
priority level lower. 

'A' is preempted by 'B'. A priority boost of 2 is not 
applied to 'B' because the result would be less than the 
current priority. 

' B 1 is preempted by • C*. 

'B' executes again, one priority level lower. 

'B* requests an I/O operation. 'A* executes at its base 
priority. 

'A 1 experiences quantum end and is rescheduled at the same 
priority (its base priority). 

'A' is preempted by 'C*. 
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STEPS AT QUANTUM END 
For Real Time Process 

1. Reset PHD$B_QUANT to full quantum value. 

2. Clear initial quantum bit PCB$V__INQUAN in PCB$L_STS. 

For Normal Process 

1. Reset PHD$B_QUANT to full quantum value. 

2. Clear initial quantum bit PCB$V_INQUAN in PCB$L_STS. 

3. If any outswapped process computable, set current software 
priority PCB$B_PRI to base priority PCB$B_PRIB. 

4. If SWAPPER needed, wake SWAPPER. 

5. If CPU limit imposed, and limit has expired, queue AST to 
process for process deletion. 

6. If not, then calculate automatic working set adjustment. 

7. Request scheduling interrupt at IPL 3. 
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WSSIZE VARIATION OVER TIME 



LU 
N 

o 

CO 



TIME' 



WSMAX- 
WSEXTENT- 


© 


® 


© 


® 




© 


















WSQUOTA— 






AWSMIN- 
MINWSCNT- 














i 


i 


i 


i 


i 



TK-9012 



Fiaure S-17 WKSTZE UariaUnn (\rizr Ti mo 



Table 5-1 Reasons for Working Set Size Variations 



Time 



b 
c 

d 



Reason for WSSIZE Change 



Page faults > PFRATH 

Free page count > BORROWLIM 

Page faults < PFRATL 

Page faults < PFRATL 

Page faults > PFRATH 

Free page count < BORROWLIM 

Page faults > PFRATH 

Free page count > BORROWLIM 
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AUTOMATIC WORKING SET ADJUSTMENT 



PAGE 

FAULT 

RATE 



PFRATH- 



PFRATL- 




WSDEC 



tt_ 



AWSMIN 
MINWSCNT 



t_ 



WSMAX 



WORKING SET SIZE 



Figure 5-18 Automatic Working Set Adjustment 
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IOTA 



O 




Program B 



$QIO 



Prog. 
B 



$WAITFR 



IOTA 



Context 
Switch 



Program A 



Figure 5-19 IOTA 



The special system parameter IOTA deducts a fixed amount from 
the time remaining in the quantum of a process whenever a process 
enters a wait state. This surcharge is not applied when the 
process is preempted by a process of higher priority. It is used 
to force processes to reach quantum end. 
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SOFTWARE PRIORITY LEVELS OF SYSTEM PROCESSES 



PROCESS 



NULL 

default user 

INPSYMB 

OPCOM 

Disk ACPs 

Tape ACPs 

ERRFMT 

JOB CONTROL 

PRTSYMBn 

NETACP 

REMACP 



SWAPPER 



~l 




. J 






1 


1 








: 3 






1 i 


i 


i 








. J 








: 3 






ID 
1 
1 
1 



4 6 8 10 12 
'Normal" Processes 



14 16 18 20 22 24 26 28 30 31 
Real-Time Processes 



Figure 5-20 Software Priority Levels of System Processes 



Most system processes have a fixed base priority established 
during system initialization. The base priority of disk and tape 
ACPs is controlled by the system parameter ACP_BASEPRIO. The 
initial base priority of a process is controlled by an argument to 
the $CREPRC system service. 
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MISCELLANEOUS RESOURCE WAITSTATES (MWAIT) 



MWAIT 
STATE 




PCB 



TK-8953 



Figure 5-21 Miscellaneous Resource Wait States (MWAIT) 

• Nonpaged Dynamic Memory 

• Modified Page List Too Large 

• Paged Dynamic Memory 
See $RSNDEF. 
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REPORT SYSTEM EVENT (RSE.MAR) 

1. System events cause transitions between process states. 

2. These transitions are effected by the routine RSE.MAR. 

3. Inputs to RSE 

a. PCB address 

b. Event number (i.e., number for WAKE, CEF SET, etc.) 

4. RSE flow 

a. Event checked for significance (e.g., WAKE only if in 
HIBER state) . 

b. PCB removed from wait queue and wait queue header 
count decremented. 

c. PCB inserted on COM or COMO state queue after priority 
adjustment, and summary bit set. 

d. Swapper process may be awakened (if PCB was inserted 
on COMO queue) . 

e. Scheduler interrupt at IPL 3 requested if the new 
computable process has software priority greater than 
that of current process. 
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PAGING 



INTRODUCTION 

There are two functions required of the memory management 
subsystem of the operating system. The first gives each user 
program the impression that it is running in contiguous physical 
memory, starting at address zero. The second function divides the 
available physical memory equitably among the users of the system. 

The first function requires that the user's virtual address 
be translated to a physical address. If the data is already in 
memory, the translation is done by hardware. When a program 
refers to data that is on disk, software is invoked to bring the 
data into memory. This software is an exception service routine 
called the pager. 

VMS implements the second function by using working sets and 
paging. Each process is required to execute with a limited amount 
of its data in memory. To avoid fragmentation of physical memory, 
this data is divided into 512 byte pieces, called pages. The 
number of valid pages a process has in memory at any time is 
called the working set. 

Because the working set limit represents the amount of 
physical memory "owned" by a process, processes at their working 
set limits must replace pages in the working set with newly 
demanded ones (rather than simply acquiring more physical memory) . 
This replacement is performed by the pager. 



OBJECTIVES 

Upon completion of this module, you will be able to: 

• Describe the effects of changing working set size, 
creating/deleting virtual address space, and 
creating/mapping a global section. 

• Discuss the programming considerations that affect paging 
overhead . 

• Given a set of initial conditions and a page request, 
describe the changes in the status and locations of pages 
and the changes in process states. 

• Discuss the effects of altering SYSGEN parameters 
governing paging. 
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RESOURCES 

Reading 

1. VAX/VMS Internals and Data Structures Manual , chapters on 
memory management data structures, paging dynamics, and 
memory management system services. 

Additional Suggested Reading 

1. VAX/VMS Internals and Data Structures Manual , chapter on 
image activation and termination. 

Source Modules 

Facility Name Module Name 

SYS PAGEFAULT 

ALLOCPFN 
SVAPTE 

SYSADJWSL,SYSLKWSET, 

SYSPURGWS 

SYSCRMPSC,SYSDGBLSC 

SYSCREDEL 

RSE 

IOCIOPOST 

RTL LIBVM 
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TOPICS 

Paging: Per process memory management 
Order of topics to be discussed: 

1. Linker action in creating executable files 

2. Image activator setting up Process Header 

3. Invoking pager routine 

4. Memory management data structures 

5. Following a process page faulted in and out of a process 

6. Following a global page faulted in and out of a process 

Reason for study: 

To understand how various sections of VMS interrelate for 
memory management 

How SYSGEN parameters relate to memory management code and 
data structures 

To be able to read the paging code 
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ADDRESS TRANSLATION 



VIRTUAL ADDRESS 

31 29 9 8 
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BYTE IN 
PAGE 



PAGE TABLE 



P' ^ 20 






PAGE FRAME NO. 


VPM ^ "* 
R 


T 














PAGE FRAME NO. 



BYTE IN 
PAGE 



PHYSICAL ADDRESS 



Figure 6-1 Address Translation 



Address translation is the hardware operation of converting a 
virtual address into a physical address for actual execution of an 
instruction. The conversion, or mapping, information is located 
in an entry in the appropriate page table. 
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RESOLVING PAGE FAULTS 



PER PROCESS 
SPACE 
PROCESS 
CONTEXT 



Process 



USER 
CODE 



PAGE FAULT 



SYSTEM 
SPACE 
PROCESS 
CONTEXT 



[ 



PAGER 



Paging File 



VIRTUAL ADDRESS SPACE 




Physical 
Memory 



STORAGE DEVICES 



Figure 6-2 Resolving Page Faults 



Pager is an exception service routine executing within the 
context of the process that incurred the page fault 

Not already in memory - read I/O issued to image file or 
page file 

Already in memory - taken from free or modified page list, 
or valid global page 



206 



PAGING 



PROCESS SECTIONS AND IMAGE FILE 
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Figure 6-3 Process Sections and Image File 



Image Sections Stored in Image File 



I. 


II. 
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IV. 


V. 


VI. 


VII. 



Read Only Data 

Read/Write Data 

Code 

User Stack 

If Run Time Library Referred to - 

RTL Transfer Vectors 

RTL Code 

RTL Private Impure Data 
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IMAGE FILE AND PROCESS HEADER 
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PROCESS HEADER 
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Figure 6-4 Image File and Process Header 



Image Activator 

- Fills in Process Section Table entries from the image 
section descriptors. 

- Fills in the Page table entries from DMZ, private and 
global pages. 

Resolves any shared addresses. 
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IMAGE SECTION DESCRIPTOR FORMATS 






end of demand 

zero section descriptor 



end of process 

private section descriptor 



end of global 
section descriptor 
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page fault 
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Figure 6-5 Image Section Descriptor Formats 
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HOW PTEs, PSTEs ARE FILLED IN 
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Figure 6-6 How PTEs, PSTEs Are Filled In 
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PAGE TABLES MAP VIRTUAL ADDRESS SPACE 
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Figure 6-7 Page Tables Map Virtual Address Space 



P0 Space 



• No Access Page 

• Image and Code 

• VMSRTL (Run Time Library) 



PI Space 



• User Stack 

• Image Specific Portion 
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DATA STRUCTURES USED BY THE PAGER 



Process 
PER PROCESS 








orALC. ■""" 

PROCESS I 
CONTEXT 1 


USER I 
CODE 1 




i t 


PAGE FAULT i r 






Process 
Header 

System 
Header 

PFN 
Database 


I 


,AGER ks 


■ 




SYSTEM 

SPACE 

PROCESS 


ESS SPACE 


WSL 
PST 


POPT 
P1PT 


CONTEXT 










SWSL 
GST 




SPT 
GPT 






VIRTUAL ADDR 





STORAGE DEVICES 



Figure 6-8 Data Structures Used by the Pager 



Table 6-1 Where Memory Management Information is Stored 



Memory Management 
Information 



Data Structure 



Process (P0 and PI space) 

System (S0 space) 
Global Sections 
Physical Memory 



Process Header - Process Section Table 
- Page Table 

System Header - System Page Table 

System Header - Global Page Tables 

PFN Data base 
(Page Frame Number) 
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PHYSICAL ADDRESS SPACE 
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Figure 6-9 Physical Address Space 



*SYSGEN 
PHYSICALPAGES 
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VIRTUAL AND PHYSICAL MEMORY 
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Figure 6-10 Virtual and Physical Memory 



• Process A has Allocated 
PFN 1 

PFN 4 
PFN 6 

• Process B has Allocated 
PFN 2 

PFN 5 
PFN 7 
PFN 8 

• Translation from virtual to physical address done using Page 
Tables (see Appendix) 
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PFN DATABASE 



Page in Process 
Working Set 



PFN 




Array 
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Longwords 
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Figure 6-11 PFN Database 

where page should go if it must leave memory 

index into working set list, 

number of processes sharing page^ 

virtual address of PTE that maps this page 

number of reasons not to put page on free or 
modified page list 

specifies list or activity 

virtual block number in swap file or page file 

type of page - e.g., process, system global 



PFN is index into arrays. 

FLINK, BLINK arrays may be longwords for large 

physical memory. 






tfl^ 
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PROCESS HEADER 



Fixed Portion of Process Header 



Working Set List 



Process Section Table 



Empty Pages 



Arrays for Process Header Pages 



PO Page Table 



P1 Page Table 



Figure 6-12 Process Header 



The process header contains all of the memory management 
information about a process. 

Four major areas of the process header are used in paging 
operations : 



Area 



SYSGEN Parameters 
VIRTUALPGCNT 



• P0 page table 

• PI page table 

• Process Section Table PROCSECTCNT 

• Working set list WSMAX 



*SYSGEN - 
VIRTUALPAGECNT 
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WORKING SET LIST 
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LOCKED 
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CURRENT 
WORKING SET 
LIST 



ROOM FOR 
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Figure 6-13 Working Set List 

• WSLAST can move to 

WSQUOTA if few free pages (free page count <BORROWLIM) 
WSEXTENT if many free pages (free page count >BORROWLIM) 

• WSNEXT - latest entry put in working set list 

• Page replacement scheme is First In, First Out 
*SYSGEN - 

BORROWLIM 

WSMAX 

PQL_DWSDEFAULT, PQL_MWSDEFAULT 

PQL_DWSEXTENT, PQL_MWSEXTENT 

PQL_DWSQUOTA, PLQ_MWSQUOTA 

MINWSCNT 
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PROCESS SECTION TABLE 
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Figure 6-14 Process Section Table 



The process section table: 

• Contains entries that locate image sections on disk 

• Grows toward lower offsets in the variable portion of the 
process header 



*SYSGEN - 
PROCSECTCNT 
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PROCESS SECTION TABLE ENTRY 
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Figure 6-15 Process Section Table Entry 



The process section table entry establishes the relationship 
between virtual pages in the address space and virtual blocks in 
an image file. 

This information is constructed from information provided by 
the linker in the image section descriptor. 

Control flags describe attributes of the section, such as: 

Global 

Copy on Reference 

Demand zero 

Writable 
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I 



PAGE FILE CONTROL BLOCK 
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Figure 6-16 Page File Control Block 
Control Block 






Bitmap 



address of bitmap 

page fault cluster 

pointer to window control block 

base virtual block number 

pages which may be allocated or reserved 



one bit per block in the page file 
bit set implies block available 



*SYSGEN - 
SWPFILCNT 
PAGFILCNT 
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DIFFERENT FORMS OF PAGE TABLE ENTRY 



VALID PTE (V=1) 





V 


PROT 


M 


FOR OS 


PFN 


INVALID PTE (V=0) 




V 


PROT 


TYPE 




POINTER 



TK-8965 



Figure 6-17 Different Forms of Page Table Entry 



Page Table Entry Field PROT 

Read/Write protection in Kernel, Executive, Supervisor, and User 
Access Modes. 



Table 6-2 Fields Pager Uses to Determine Location of Page 



Type 



Pointer 



Demand zero page 
Page in transition 
Invalid global page 
Page in paging file 
Page in image file 





Page Frame Number (PFN) 

Global Section Table Index 

Paging File Virtual Block Number 

Process Section Table Index 
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PROCESS PTEs MAP TO GLOBAL PTEs 
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Figure 6-18 Process PTEs Map to Global PTEs 



The page table entries associated with a global section table 
entry are in the global page table. 

When processes map a global section, correspondence is 
established between process PTEs and global PTEs. 

*SYSGEN - 

GBLPAGES 

GBLPAGFIL 
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RELATIONSHIP AMONG GLOBAL SECTION 
DATA STRUCTURES 



Global Section 
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Global Section Descriptor 
Figure 6-19 Relationship Among Global Section Data Structures 

Three data structures contain global section information. 

• global page table and 

• global section table perform similar roles to those of the 
process page tables and process section table 

• global section descriptors allow the location of global 
section information by name 

• GSDs are placed in either a system queue or a group queue 
*SYSGEN - 

GBLSECTIONS 
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SUMMARY OF THE PAGER 
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Figure 6-20 Summary of the Pager 
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INTRODUCTION - PAGING DYNAMICS EXAMPLES 

• Process Read/Write Section Page 
Result of $CRMPSC for private section 

• Process Copy-on-Ref erence Page 
For example, read/write data 

• Global Read/Write Section Page 
Result of $CRMPSC for global section 
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INITIAL STATUS OF PROCESS READ/WRITE 
SECTION PAGE 
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Figure 6-21 Initial Status of Process Read/Write Section Page 



A. Page must be found through the process section table entry 
pointing to portion of an image file. 

B. No connection between the process header structures and the 
PFN data base . 
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ADDING PROCESS READ/WRITE SECTION 
TO WORKING SET 



Process Header 
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Figure 6-22 Adding Process Read/Write Section to Working Set 
Page read complete 

A. PTE contains PFN 

B. Working set list entry points to PTE 

C. Index to working set list entry 

D. Index to process section table entry (was filled in from 
PTE) 

E. Backward pointer to system virtual address of PTE 
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REMOVING MODIFIED PROCESS READ/WRITE SECTION 
PAGE FROM WORKING SET 
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Figure 6-23 Removing Modified Process Read/Write Section Page 

from Working Set 



A. Links to WSL have been broken 

B. PFN still in PTE allows page to be faulted without disk 
I/O 

C. Index to PSTE still on BAK - where to save now modified 
page 

D. Backward pointer to PTE for modified page writer 
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MOVING PAGE FROM MODIFIED PAGE LIST 
TO FREE PAGE LIST 
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Figure 6-24 Moving Page from Modified Page List to 

Free Page List 



(Page has been written back to image file on disk by modified page 
writer . ) 

A. PFN still in PTE allows page to be faulted without I/O 

B. Index to PSTE still in BAK - must save for PTE 

C. Backward pointer to PTE for pager 
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REMOVING PAGE FROM FREE PAGE LIST 
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Figure 6-25 Removing Page from Free Page List 



If page not faulted from free page list: 

A. PFN data base entries point somewhere else 

B. Process section table index has been put back into PTE 
Data structures back to original states. 
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INITIAL STATUS OF PROCESS COPY-ON-REFERENCE PAGE 



Process Header 



WSL 












PST 




Locates Image 
Section on Disk 






Page Table 

" ~ rT "" T *" "dot v" ~ *J 


m _ u [_ _ jm L<>_ _ -. 





PFN Database Arrays 



Somewhere 
Else <— 



FREE PAGE 
LIST 



WSLX 
BAK 
PTE 

STATE 



Figure 6-26 Initial Status of Process Copy-on-Ref erence Page 



The initial state of this example is identical to that of a 
process read/write section page, except that copy-on-ref erence 
bits are set in the process section table entry and the PTE. 
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ADDING PROCESS COPY-ON-REFERENCE PAGE 
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Figure 6-27 Adding Process Copy-on-Ref erence 
Page to Working Set 



When the page is faulted into the working set, the same basic 
operations are performed as for a process read/write section page, 
except that 

A. BAK indicates a reserved page in the page file 

B. the modify bit in the STATE array is automatically set 



This page is never associated with the original image file 



again 
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REMOVING PROCESS COPY-ON-REFERENCE SECTION PAGE 
FROM WORKING SET 
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Figure 6-28 Removing Process Copy-on-Ref erence Section 

Page from Working Set 



When this page is removed from the working set, it is placed 
in the modified list because the modify bit had been set in the 
previous step. 
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REMOVING PROCESS COPY-ON-REFERENCE PAGE FROM 
MODIFIED PAGE LIST 
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Figure 6-29 Removing Process Copy-on-Reference Page from 

Modified Page List 

A. When this page filters through the modified list, the 
contents of the page are written to the page file. 

B. When the page is allocated to another process from the 
head of the free list, all links between the process 
header and the PFN data base are broken. 

C. The PTE points to the location of the page in the page 
file, from which it can later be faulted. 
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Figure 6-30 Initial Status of Global Read/Write Section Page 



B. 



When Process A maps the global section, the PTEs point to 
the corresponding global page table entries for the 
section. 

Each of the GPTEs points to the global section table entry 
which, in turn, points to the section file. 



235 



PAGING 



ADDING GLOBAL READ/WRITE SECTION PAGE 
TO WORKING SET 



Process Header A 



WSL 



PAGE TABLE 



iIIIIIj»fn| 



® 



System Header 



Global 
Section Table 



Locates Global 
Section on Disk 



Tl 



PFN Database Arrays 



© 



Global 
Page Table 



l "?J"I""pfn| 



® 



■*GSTX 



GPTE 



VALID 



SHRCNT 

BAK 

PTE 

STATE 



Figure 6-31 Adding Global Read/Wrrte-Section Page to 

Working Set 

When Process A faults the global page 

A. both the process PTE and the GPTE contain the page frame 
number 

B. the PFN data base points only to the system header data 
structures (GSTE and GPTE) 

C. the SHRCNT is initialized to 1 
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INITIAL STATUS OF PTE OF SECOND PROCESS MAPPING 
THE SAME GLOBAL SECTION 
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Figure 6-32 Initial Status of PTE of Second Process 
Mapping the Same Global Section 



A. When Process B maps the same global section, its PTE 
contains the GPTX. 



237 



PAGING 



ADDING GLOBAL READ/WRITE SECTION PAGE 
TO SECOND WORKING SET 
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Figure 6-33 Adding Global Read /Wri te Section Page 
to Second Working Set 



A. When Process B faults the same global page as Process A, 
the PTE of Process B also points to the page frame. 

B. The only change in the system data structures is the 
incrementing of the SHRCNT value to two. 
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REMOVING GLOBAL READ/ WRITE SECTION PAGE FROM WORKING SET 
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Figure 6-34 Removing Global Read/WHrfee Section Page 

from Working Set 

Eventually both processes release the global pages from their 
working sets. 

A. As each process loses page from working set, the PFN in 
the process PTE is overwritten by GPTX. 

B. The relationships between the system header data 
structures and the PFN data base are similar to those for 
a process private page on the free list. 

C. The global page is placed on the page lists only after 
SHRCNT is decremented to zero. 
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REMOVING GLOBAL READ/WRITE SECTION PAGE FROM LIST 
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Figure 6-35 Removing Global Read/Write Section 

Page from List 

When the page is allocated to another process from the head 
of the free list 

A. The system header data structures are returned to their 
initial states. 

B. All links to the PFN data base are destroyed. 
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APPENDIX 

PAGE READ CLUSTERING 
Why Cluster Pages 

• More efficient QIO. 

• Makes image activation easier. 

• Bring into working set pages that potentially will be 
referenced . 

How a Cluster Is Made 

Pager scans successive PTE • s for the same backing store 
address. 

Examples : 

• PSTX 

• Consecutive pagefile VBN's 

• Consecutive GPTE's with same GSTX 
Pager scans until: 

• No more WSLE's are available 

• No physical pages available 

• Page table page for PTE not valid 

• Maximum cluster size reached 

If no page can be clustered, previous PTE's are scanned using 
above rules. 
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Maximum Cluster Size Determination 

Table 6-3 Cluster Sizes and Where They Are Stored 



Pa 9 e Cluster Size 



Global Page Tables l 

Process Page Tables PAGTBLPFC 

Paging File Pages PFL$B_PFC/PFCDEFAULT 

Process, Global Sections SEC$B PFC/PFCDEFAULT 



Changing/Controlling Cluster Size 

• SYSGEN parameters 

- PFCDEFAULT 

- PAGTBLPFC 

• PFC argument in $CREPRC 

• Linker option 

(cluster =clustername, [base_adr] , [pfc]f ile spec [ , .. .] 
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PROGRAM SECTIONS (.PSECTs) 
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Figure 6-36 Program Sections (.PSECTs) 
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LINKER CLUSTERS 



OBJECT MODULES 
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Figure 6-37 Linker Clusters 



TK-8962 
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PROGRAM SECTION ATTRIBUTES GBL/LCL 



$LINKA.OPT/OPTIONS 



CLUSTER=AA,„MODULE1 
CLUSTER=BB ,„MODULE2 



GBL 
MODULE1.0BJ IMAGE FILE 



.PSECT A 



MODULE2.0BJ 



.PSECT A 



> CLUSTER AA 



LCL 



MODULE. OBJ 



IMAGE FILE 



>CLUSTERBB 



Since MODULE1 is the first to contribute to 
.PSECT A, and since MODULE 1 is designated 
as being in cluster AA, all future .PSECT A 
contributions go to cluster AA. 




MODULE2.0BJ 




> CLUSTER AA 



^CLUSTER BB 



Since .PSECT A is designated LCL, each 
module's contribution goes to that 
module's own cluster. 



Figure 6-38 Program Section Attributes GBL/LCL 
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HARDWARE CHECKS 
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Figure 6-39 Hardware Checks 



Before address translation occurs, the hardware checks the 
type of request (read or modify/write) against 

• The protection field of the corresponding page table entry 
(PTE) . 

• The current access mode field of the processor status 
longword (PSL) 

If access is denied, no address translation occurs and an 
access violation condition is signaled. 
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VIRTUAL ADDRESS SPACE 



VIRTUAL 
ADDRESS (VA) 


00 


000 


000 


00 


000 


200 


00 


000 


400 


3F 


FFF 


AOO 


3F 


FFF 


COO 


3F 


FFF 


EOO 


40 


000 


000 


40 


000 


200 


40 


000 


400 


7F 


FFF 


AOO 


7F 


FFF 


COO 


7F 


FFF 


EOO 


80 


000 


000 


80 


000 


200 


80 


000 


400 


BF 


FFF 


AOO 


BF 


FFF 


COO 


BF 


FFF 


EOO 


CO 


000 


000 


CO 


000 


200 


CO 


000 


400 


FF 


FFF 


AOO 


FF 


FFF 


COO 


FF 


FFF 


EOO 



VIRTUAL PAGE 
NUMBER (VPN) 

000 000 

000 001 

000 002 



-» 


^-v 






1FF FFD 




1FF FFF 




1FF FFF 




000 000 




000 001 


% 


w, 


000 002 


— * 


7. 


L 




1FF FFD 




1FF FFE 




1FF FFF 




000 000 




000 001 




000 002 


w 


£ 






1F FFD 




1FF FFE 




1FF FFF 




000 000 




000 001 




000 002 


^ 




— * 




1FF FFD 




1FF FFE 




1FF FFF 



40 
40 


000 ' 
000 


MX) 
401 


it <r 


3 


2 


1 





7 


6 


5 


4 


• • • 


8 


BYTE WITHIN PAGE 
(BWP) 


503 


• • • 


507 


506 


505 


504 


511 


510 


509 


508 


i 


\ 1 


i 


40 
40 


OOC 

oor 


5FE 
5FF 



VIRTUAL PAGE 
> NUMBER 000 002 
IN P1 SPACE 



32-BIT VIRTUAL ADDRESS 



3130 29 



09 08 



00 



VPN 



BWP 



0-PO 

1 -P1 

1 0-SO 
1 1 -S1 



Figure 6-40 Virtual Address Space 



247 



PAGE TABLE MAPPING 



PAGING 



S REGION 



VIRTUAL ADDRESS 
SPACE 




PDPT 






POBR 


PO 


MAPPED 
PAGES 
















/ j 




t. 

2 
1 




▲ 




• Base Address / 


















LengthO 


POLR 








/ j 




v 




LengthO / 




I 


NON-EXISTENT 










UNMAPPED 
PAGES 


m r i Lb 

T L _J 

A r "1 




P1 


UNMAPPED 
PAGES 




P1BR 




/ > 






■ Base Address t 




T j NON-EXISTENT 
l 2 1 1 PTEs 

2 










P1LR 




/ y 




1 






2""- Lengthl / 




1 




: 


i 








MAPPED 
PAGES 


Lengthl 




S 


r 


- r 


SBR 


MAPPED 
PAGES 












/ > 






SKI 




■ Base Address / 




t. 

2 

J 




\ 


SLR 




. 


L 






Length2 




/ j 




UNMAPPED 
PAGES 


r 




Length2 ) 




NON-EXISTENT 
PTEs 

PHYSICAL 


i 
i 














MEMORY 









Figure 6-41 Page Table Mapping 



All page tables are mapped in system space. Each page table 
is located through the corresponding processor base register, and 
its length is indicated by the corresponding processor length 
register. The system page table is permanently resident in memory 
and located by physical address. 
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SYSTEM SPACE ADDRESS TRANSLATION 



CHECK THAT ADDRESS 
IS WITHIN BOUNDS OF 
PAGE TABLE 



CALCULATE PHYSICAL 
ADDRESS OF PTE 




-♦NO. PROCESS SPACE 



YES, SYSTEM SPACE 
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Figure 6-42 System Space Address Translation 
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page table entry 
(physical) page frame number 
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PROCESS SPACE ADDRESS TRANSLATION 
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Figure 6-43 Process Space Address Translation 



1. Find SVA of PTE 

2. Get physical address of PTE 

3. Get physical address of P0 page 
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VIRTUAL TO PHYSICAL ADDRESS TRANSLATION 
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Figure 6-44 Virtual to Physical Address Translation 



Note: This figure assumes that all SPTEs are valid. 
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SWAPPING 



INTRODUCTION 

The swapper is a process. The code of the swapper is part of 
the system image and executes in kernel access mode in S0 space. 

The swapper is responsible for memory management on a 
system-wide basis. While the pager is the component servicing the 
demands within a process, the swapper balances the demands for 
physical memory by all of the processes in the system and the 
pageable portion of the operating system. To accomplish this 
purpose, three operations are performed by the swapper: 

• inswap/outswap 

• modified page writing 

• shrinking working sets 

Inswap/outswap operations are transfers of working sets 
between memory and disk. 

Outswapping operations typically release over 100 pages at a 
time, and provide a rapid way to replenish the free page list. 
Included in these transfers are: 

• the P0 and PI space pages that are memory-resident and 
valid, and 

• the process headers (including the hardware context, 
accounting information, and all of the memory management 
data structures of the process) . 

The only information normally retained in physical memory 
after a process has been outswapped is found in data structures 
allocated from nonpaged dynamic memory, particularly the software 
process control block (PCB) and the job information block (JIB) . 

Modified page writing also is performed by the swapper 
process. When pages are needed, they always are allocated from 
the free page list. 

Pages are provided for allocation by writing modified pages 
to their backing storage locations and then inserting the pages on 
the free page list. 

Before the swapper outswaps a process, it will attempt to 
replenish the free page list by taking pages from the process 
working set (shrinking the working set) . 
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The swapper also is involved in both process creation and 
system initialization. 

This is discussed in the course modules "Process Creation and 

Deletion" and "System Initialization and Shutdown." 



OBJECTIVES 

1. Describe the swapping operation (inswap/outswap, handling 
I/O in progress, and global pages). 

2. Determine the best size and placement for a system's swap 
file or files. 

3. Explain why swapping is performed when paging also is 
implemented in VAX/VMS. 

4. Discuss the effects of altering SYSGEN parameters relating 
to swapping. 



RESOURCES 

Reading 

1. VAX/VMS Internals and Data Structures Manual , chapter on 
swapping —— ~~ 

Additional Suggested Reading 

1. VAX/VMS Internals and Data Structures Manual , chapters on 
memory management data structures, paging dynamics, and 
memory management system services 

Source Modules 

Facility Name Module Name 

SYS PAGEFILE 

SWAPPER 
OSWPSCHED 
SDAT 
SHELL 
WRTMFYPAG 

IOCIOPOST 
SYSUPDSEC 
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TOPICS 

I. Comparison of Paging and Swapping 
II. Swapper functions 

A. Maintain free page count 

Write modified pages to paging file 
Shrink working sets 

B. Outswap - rules and example 

C. Inswap - Rules and Example 
III. Selected Events that Wake Swapper 

IV. Locating Disk Files for Swap 
V. How Swapper's P0 Page Table Is Used to Speed Disk I/O 
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SWAPPER 

• Description of Code 

located in S0 space 

- separate process 

- part of system image 

- executes in kernel mode only 

• Function 

To control memory for the entire system through 

- modified page writing 

- shrinking of working sets 
inswapping/outswapping of working sets 
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COMPARISON OF PAGING AND SWAPPING 

Table 7-1 Comparison of Paging and Swapping 
Differences 



Paging 



Swapping 



Function 



Supports programs with 
very large address 
spaces . 



Implementation Moves pages into and 
out of process 
working sets. 



How Invoked 



Unit 



Exception service 
routine that executes 
in the context of the 
process that incurred 
the page fault. 



the page 



Supports a large 
number of con- 
currently active 
processes . 

Moves entire processes 
into and out of 
physical memory. 

Separate process that 
is awakened from its 
hibernating state by 
components that detect 
a need for swapper 
activity. 

The process working 
set 



Similarities 

1. The pager and swapper work from a common data base. 

2. The pager and swapper do conventional I/O. 

3. Both components attempt to maximize the number of blocks read 
or written with a given I/O request. 

*SYSGEN - 

MPWPRIO 

SWPPRIO 
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SWAPPER MAIN LOOP 



Wake Swapper 



►(Start H" 




Maintain Free 
Page Count 



Write Modified 
Pages 



OUTSWAP/ 
INSWAP 



No 




Give Requested 
Power Fail Asts 




Figure 7-1 Swapper Main Loop 



*SYSGEN - 
MPW_WRTC LUSTER 
FREELIM 
MPW_HILIMIT 
MPW LOLIMIT 
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MAINTAINING FREE PAGE COUNT 

To maintain at least FREELIM free pages, swapper will attempt 
to : 

1. Reclaim pages from deleted process headers 

2. Write modified pages 

• if (FREEGOAL minus number on free list) < 
(number on modified list minus MPW_LOLIMIT) 

• will stop writing at MPW_LOLIMIT 

3. Shrink working sets to SWPOUTPGCNT pages 

4. Outswap processes 

*SYSGEN - 
SWPOUTPGCNT 
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ORDER OF SEARCH FOR POTENTIAL OUTSWAP CANDIDATES 



Table 7-2 Order of Search for Potential Outswap Candidates 



Process State (Mnemonic) 



Priority Initial 

Important Quantum 



Additional 
Notes 



Suspended (SUSP) No 

Local Event Flag Wait (LEF) No 



Hibernating (HIB) 



No 



Common Event Flag Wait (CEF) No 



Local Event Flag Wait (LEF) No 



Hibernating (HIB) 



No 



Free Page Wait (FPG) Yes 

Collided Page Wait (COLPG) Yes 

Miscellaneous Wait (MWAIT) No 

Common Event Flag Wait (CEF) Yes 

Local Event Flag Wait (LEF) Yes 



Page Fault Wait (PFW) 
Computable (COM) 



Yes 
Yes 



No 
No 

No 



No 



No 



No 



No 
No 
No 
Yes 

Yes 

Yes 
Yes 



Direct I/O count must 
be zero, longwait 

Longwait 



Direct I/O count 
must be zero 

Direct I/O count 
must be zero, not 
longwait 

Not longwait 



Direct I/O count 
cannot be zero 

Direct I/O count 
cannot be zero 
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For an Outswap Table Section 

Shrink candidates' working sets to WSQUOTA 

- Shrink candidates' working sets to SWPOUTPGCNT (initial 
quantum check) 

Select outswap candidate (initial quantum check) 

If free page deficit not balanced and no outswap candidate, 
go to next outswap table section. 

*SYSGEN 

LONG WAIT 
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EXPANDING AND SHRINKING WORKING SETS 



© 
BORROWLIM 



t 



FREELIM 
® 



1 



FREEGOAL 



GROWLIM 



© 
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WSEXTENT 



WSQUOTA 
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MINWSCNT 



Number of Pages 
on Free Page List 



Number of Pages 
in Working Set 



Figure 7-2 Expanding and Shrinking Working Sets 



O If free page count > BORROWLIM, working set may grow past 
WSQUOTA to WSEXTENT. 

If free page count < FREELIM, swapper will attempt to 

- Shrink working sets from WSEXTENT to WSQUOTA 

- Shrink working sets from WSQUOTA to SWPOUTPGCNT 
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WAKING THE SWAPPER OR MODIFIED PAGE WRITER 



Table 7-3 Selected Events that Cause the Swapper or 
Modified Page Writer to Be Awakened 



Event 



Module 



Process that is outswap- RSE 
ped becomes computable 

Quantum end RSE 



CPU time expiration RSE 



Process enters wait SYSWAIT 
state 

Modified page list ALLOCPFN 

exceeds upper limit 

threshold 



Additional Comments 



Swapper will attempt to make 
this process resident 

Outswap previously blocked by 
initial quantum flag setting 
may now be possible 

Process may be deleted, allowing 
previously blocked inswap to occur 

Process that entered wait state 
may be suitable outswap candidate 

Modified page writing is performed 
by swapper 



Free page list drops 
below low limit 
threshold 



Balance slot of deleted 
process becomes 
available 



ALLOCPFN Swapper must balance free page cour 
by: 

1. Writing modified pages 

2. Swapping headers of previously 
outswapped process bodies 
Shrinking working sets 

3. Swapping more processes 

SYSDELPRC Previously blocked inswap may now 
be possible 



Process header reference 
count goes to zero 



System timer subroutine 
executes 



PAGEFAULT Process header can now be outswappe 
to join previously outswapped pro- 
cess body 

TIMESCHDL The swapper is awakened every 

second to check if there is any 
work to be done 
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OVERVIEW OF SWAPPER FUNCTIONS 



User Process 
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Figure 7-3 Overview of Swapper Functions 



Outswap 

a P0 and PI pages are "adopted" into swappers P0 space 

d,e Process outswapped to swap file/page file 

b PHD pages are "adopted" into swappers P0 space 

d,e PHD outswapped to swap file/page file 



Inswap 



Reverse of outswap 



Modified page Writing 

f Selected modified pages "adopted" to swappers P0 space 

e Modified pages written to page file 

g "Modified" pages transferred to free page list 

Process Creation 

c SHELL copied to swappers P0 space 
a,b SHELL code and data transferred to PI and PHD 
of new process 
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LOCATING DISK FILES FOR SWAP 



PROCESSES X, Y 
ALREADY EXIST 
AND ARE 
CURRENTLY 
OUTSWAPPED 



PCB 

for 

Process X 



WSSWP 



PCB 

for 

Process Y 



WSSWP 



Entry 1 
Locates SWAPFILE.SYS 



Entry SWPFILCNT+1 
Locates PAGEFILE.SYS 




SWAPFILE.SYS 



U t 




Swap Slot 
for Process X 



U 




PAGEFILE.SYS 

a — r 




Swap Slot 
for Process Y 



Figure 7-4 Locating Disk Files for Swap 



The choice of swap file or page file is determined by a field 
in the PCB called WSSWP. 

The use of a swap file is optional; however, using swap 
files should improve performance. 

Swap slots are assigned dynamically in increments of 
SWAPALLOCINC, up to WSQUOTA pages. 

*SYSGEN - 

SWPFILCNT 

PAGFILCNT 
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HOW SWAPPER'S PO PAGE TABLE IS USED TO SPEED SWAP I/O 



Process' 
Virtual 

Address 
Space 



Swapper's 

Virtual PO 

Address 

Space 



VAX 
Physical 
Memory 




# 



SWAP SLOT 



® 



© 



Figure 7-5 How Swapper's P0 Table Is Used to Speed Swap I/O 

Q Working set pages usually virtually discontiguous in 
process address space. 

Q Mapped to virtually contiguous addresses in swapper's P0 
space. 

Both virtual pages correspond to same PFNs in physical 
memory. 

$QIO on swapper's contiguous virtual addresses — > one I/O 
to disk (QIO issued with base virtual address and byte 
count) . 
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SWAPPER'S PSEUDO PAGE TABLES 



SWP$GL_MAP :: • 
(This address is stored 
in the swapper's PO 
base register.) 



Swapper's 

I/O 

Page Table 

Entry 

Array of 

Longwords 






-\ 



MPWSAI PTE :: *■ 



Modified 

Page Writer's 

I/O 

/p Page Table / J 

Entry 

Array of 

Longwords 



>n 



WSMAX 

lements 
(This number is stored in 
the swapper's PO length 
register.) 



J 



r 



ft 



>MPW_WRTCLUSTER j 
elements V 



ft 
ft 



K. 



MPW's 
Process 
Header 
Vector ^k 
Index 
Array 

of 
Words 



MPW$AW_PHVIND 



Figure 7-6 Swapper's Pseudo Page Tables 



Swapper can have one swap I/O and one modified page write I/O 
in progress at the same time. 
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PARTIAL OUTSWAPS AND THE PROCESS HEADER 

• In partial outswap, process body outswapped, process 
header remains resident 

• Reason for partial outswap - pages locked in memory 

- $LCKPAG or direct I/O 

Locked pages and PHD stay in memory 

• Note that $LCKWSET has no effect on PHD being outswapped 

• Effects of partial outswap 

Balance slot still occupied, preventing another 
process getting inswapped (BALSETCNT = maximum number 
of resident processes, MAXPROCCNT >= BALSETCNT) 

On inswap, if PHD still resident, only process body is 
inswapped, so process page tables are rebuilt, but not 
system page table entries mapping PHD. 

• PHD size = f (PHD$K_LENGTH, WSMAX, PROCSECTCNT, 
VIRTUALPAGECNT) 
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OUTSWAP RULES 



Table 7-4 Rules for Scan of Working Set List on Outswap 



Type of Page 



Valid 



Action of Swapper for this Page 



1. Process 
Page 



Valid 



2. System 
Page 



3. Global 
Read Only 



Valid 



4. Global 

Read/Write 



Outswap page. 

If there is outstanding I/O and the 
page is modified, load SWPVBN array 
element with block in swap/page file 
where the updated page contents 
should be written when the I/O 
completes. 

Impossible for system page to be in 
process working set. Swapper 
generates an error. 

a. If SHRCNT = 1, then outswap. 

b. If SHRCNT > 1, DROP from working set 
It is highly likely that process can 
fault page later without I/O. This 
check avoids multiple copies of same 
page in swap page file. 

DROP from working set. It is ex- 
tremely difficult to determine whetht 
page in memory was modified after 
this copy was written to the swap pac 
file. 



5. Page Table 
Page 



Not part of process body. However, 
while scanning process body, VPN 
field in WSL is modified to reflect 
offset from beginning process 
header because page table pages will 
probably be located at different 
virtual addresses following inswap. 



The scan of the working set list on outswap is keyed off a 
combination of the physical page type (WSL<3:1>) and the valid bit 
(PTE<31>) . 
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OUTSWAP - WORKING SET LIST BEFORE OUTSWAP SCAN 





Process Header for 
swapped process 




Working Set List 




vpn Y 


GRO 




vpn Z 


PPG 




vpn W 


GRW 




vpn x 


PPG 




PO Page Table 


vpnW 


1 pin B 






vpn X 


1 pin D 






vpn Y 


1 pfn A 






vpn Z 


1 pfnC 







WSLX 



PTE 



BAK 



STATE TYPE 



other 



wsle 1 
wsle 2 
wsle 3 
wsle 4 



| gpte O | 1 gstx ] | act | |GRo| |SHRCNT =~ 



| - | | gpte R | | gstx j | act | |GRW| JSHRCNT = 4] 



C | wsle 2 | | pteZ \ | pgtlx | | act | | PPG | |REFCNT = 2| 
wsle 4 | | pte X | j pstx | | act | |PPG| 
PFN Database Arrays 



pte W 



pte X 



pte Y 



pteZ 





global page table 






gpte Q 


valid, pfn A 






gpte R 


valid, pfn B 







SWP$GL_MAP :: 



Swapper's 
I/O Map 



Z2 



Figure 7-7 Outswap - Working Set List Before Outswap Scan 



Y 
Z 
W 
X 



Global read only, in only this process working set 
Process page, direct I/O in progress 
Global read/write, in four process working sets 
Process page 



This is the state of the data structures before the swapper 
takes any action. 
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OUTSWAP - WORKING SET LIST AFTER OUTSWAP SCAN 





Process Header for 
swapped process 




Working Set List 




vpn Y 


GRO 


© 


vpn Z 


PPG 






vpn X 


PPG 




PO Page Table 


vpn W 


gptx (R) 






vpn X 


1 pfnD 






vpn Y 


1 pfn A 






vpn Z 


1 pfnC 







wsle 1 
wsle 2 
wsle 3 
wsle 4 





WSLX 




PTE 


*l 




gpte 








B l 


wsle 2 


gpte R 


c| 


pteZ 








°l 


wsle 4 


pte X 



STATE TYPE 



other 



gst» j | act | |gro| J SHRCNT ~ 
| act | |GRW| j SHRCNT =~ 



gstx 



pgflx 



pstx 



| act | | PPG | | REFCNT =~ 

ED EED 



PFN Database Arrays 



pte W 



pte X 



pte Y 



pte Z 





global page table 






gpte Q 


valid, pfn A 






gpte R 


valid, pfn B 







SWP$GL_MAP : 



Swapper's 
I/O Map 


1 


pfn 


A 


1 


pfn 


C 


1 


ptn 








Zl 



® 



Figure 7-8 Outswap - Working Set List After Outswap Scan 

The global read/write page is removed front the working 
set. 

The remaining elements of the working set are mapped by 
the I/O map, and then the I/O request is made. 
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OUTSWAP - PROCESS PAGE TABLE CHANGES AFTER 
SWAPPER'S WRITE COMPLETES 





Process Header for 
swapped process 




Working Set List 




vpn y 


GRO 




vpn z 


PPG 










vpn X 


PPG 




PO Page Table 


vpn W 


gptx (R) 






vpn X 


pslx 






vpn Y 


gptx (0) 






vpn Z 


pfn C 







WSLX 



PTE 



BAK 



(T) A [ BLINK | | gpte 



gstx 



SHRCNT = 



wsle 1 
wsle 2 
wsle 3 
wsle 4 



B 



I - | | 9PteR 



gstx 



SHRCNT = 3 



© 
© 



C I wsle 2 
D I BLINK 



pteZ 



pgflx 



STATE TYPE 

| act | |GRW| 

| act | | PPG | | RSFCNT=T 

[ppg| 



PFN Database Arrays 



pte W 



pte X 



pte Y 



pteZ 





global page table 






gpte Q 


trans, pfn A 






gpte R 


valid, pfn B 







SWPSGL-MAP :: 



Swapper's 
I/O Map 



*-l 



Figure 7-9 Outswap - Process Table Changes After Swapper's 

Write Completes 



The global read-only page and the process page without I/O are 
placed on the free list. 

Q Same as one . 

The remaining process page (with I/O) has its REFCNT 
decremented by one . 
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INSWAP RULES 



Table 7-5 Rules for Rebuilding the Working Set List and the 

Process Page Tables at Inswap 

Type of Page Table 
Entry 



Action of Swapper for this 
Page 



1. PTE is valid 



2. PTE indicates a transition 
page (probably due to 
outstanding I/O when pro- 
cess was outswapped) 

3. PTE contains a global page 
table index (GPTX) 



(Page must be global read- 
only because global read/- 
write pages were dropped 
from the working set at 
outswap time) 



Page is locked into memory and 
was never outswapped. 

Fault transition page into 
process working set. Release 
duplicate page that was just 
swapped in. 

Swapper action is based on the 
contents of the global page 
table entry (GPTE) . 

a. If the global page table 
entry is valid, add the 
PFN in the GPTE to the 
process working set and 
release the duplicate page. 

b. If the global page table entry 
indicates a transition page, 
make the global page table 
entry valid, add that physical 
page to the process working 
set, and release the duplicate 
page . 

c. If the global page table entry 
indicates a global section 
table index, then keep the page 
just swapped in, and make that 
the master page in the global 
page table entry as well as the 
slave page in the process page 
table entry. 
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Table 7-5 Rules for Rebuilding the Working Set List and the 
Process Page Tables at Inswap (Cont) 

Type of Page Table Action of Swapper for this 

Entry Page 

4. PTE contains a page file This is the usual content for 
index or a process section pages that did not have out- 
table index standing I/O or other page re- 
ferences when the process was 
outswapped . 

The PFN in the swapper map is 
inserted into the process page 
table. The PFN arrays are 
initialized for that page. 

At inswap time the swapper uses the contents of the page 
table entry to determine what action to take for each particular 
page. 
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INSWAP - WORKING SET LIST AND SWAPPER MAP BEFORE 
PHYSICAL PAGE ALLOCATION 





Process Header for 
swapped process 




Working Set List 




vpn x 


GRO 




vpn W 


PPG 




vpn Y 


GRO 




vpn Z 


PPG 




PO Page Table 


vpn W 


pstx 






vpn X 


gptx (T| 






vpn Y 


gptx (S) 






vpn Z 


pfn A 







WSLX 



PTE 



BAK 



STATE TYPE 



other 



wsle 1 
wsle 2 
wsle 3 
wsle 4 



A | blink | | pte Z j pgfix \ | free | | | 

B | - | | gpte S | gslx ] | act | |GR0| JSHRCNT =~3 

C | BLINK | | | | pgflx j | free | j ||| 

D | BLINK | j j f pstx | | tree | [*""*"] 



PFN Database Arrays 



pte W 



pteX 



pte Y 



pteZ 





global page table 






gpte S 


valid, pfn B 






gpte T 


gstx 







SWP$GL_MAP 



Swapper's 
I/O Map 



«-I 



Figure 7-10 Inswap - Working Set List and Swapper Map 
Before Physical Page Allocation 



X - Global read only, not in memory 

W - Process page, not in memory 

Y - Global read only, copy in memory (valid GPTE) 

Z - Process page, on free page list 

This is the state of the data structures before the swapper 
takes any action. 

NOTE 
Process header was not outswapped so it does 
not need to be inswapped. 
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INSWAP - WORKING SET LIST AND SWAPPER MAP AFTER 
PHYSICAL PAGE ALLOCATION 





Process Header for 
swapped process 




Working Set List 




vpn x 


GRO 




vpn vw 


PPG 




vpn y 


GRO 




vpn z 


PPG 




PO Page Table 


vpn W 


o pstx 






vpn X 


o gptx (T) 






vpn Y 
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vpn Z 
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pte X 



pte Y 



pteZ 



gpte S 



gpte T 



PTE 
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BAK STATE TYPE other 
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gpte S 
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I ED □ 



ED □ 



PFN Database Arrays 



global page table 






J 






Swapper's 
I/O Map 


valid, pfn B 








gstx 




1 pfn D 








1 pfn C 


© 




1 pfn E 




1 pfn F 











Figure 7-11 Inswap - Working Set List and Swapper Map After 

Physical Page Allocation 



A Swapper allocates pages from free page list for every page in 
the process working set. 

Q Swapper copies PFNs into its P0 space. 

Swapper issues read from disk which copies swapped working set 
into physical memory. 
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INSWAP - WORKING SET LIST AND REBUILT PAGE TABLES 





Process Header tor 
swapped process 




Working Set List 




vpn x 


GRO 




vpn w 


PPG 




vpn v 


GRO 




vpn z 


PPG 




PO Page Table 


vpn W 


1 pfnC 






vpn X 


1 pfnD 






vpn Y 


1 pfnB 






vpn Z 


1 pfn A 







wsle 
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wsl 
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© 
,© 

© 



WSLX 



PTE 



BAK 



STATE TYPE 



other 



A 


wsle 4 | | pte Z 
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! | gp'es 






C 
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I [ gpte T 






E 


BLINK | | 
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BLINK | | 



P9"x 



| PPG | 



gstx | | act | |GRO| |SHRCNT s 7\ 



pstx | | act | | PPG | 



gstx j | act | |gro| |shrcnt = i"| 

~~ i E3 r~i 



pte W 



pte X 



pte Y 



pteZ 



PFN Database Arrays 





global page table 






gpte S 


valid, pfn B 






gpte T 


valid, pfn D 







SWP$GL MAP :m 



Swapper's 
I/O Map 



Zl 



Figure 7-12 Inswap - Working Set List and Rebuilt Page Tables 

- pfn A still on free list so made valid. 

- pfn E — > free page list 

- pfn B still valid so SHRCNT upped to 4 

- pfn copied to PTE Y 

- pfn F — > free page list 

pfn C copied to PTE W 

- pfn D copies to PTE X 

- SHRCNT = 1 

The actual order of operations is 4,3,1,2. 
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HOW MODIFIED PAGE WRITER GATHERS PAGES 



Modified 
Page List 

PTE 

B 
c 
D 

E 
F 



Balance Slot 
Area 



transition PTE (free List) 



PFN D 



PFN A 






PFNC 



PFN (valid) 



St 



process section table index 



PFN E 






PFN B 






PFN F 



correct PGFLX but cluster 
full 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



Modified Page 
Writer's Map 



1 PFN D 


i 


1 PFN A 


• 
• 
• 


1 PFN C 


' 1 PFN E 


• 
• 
• 


1 PFN B 


• 
• 
• 


1 PFN F 



Figure 7-13 How Modified Page Writer Gathers Pages 



Gather pages around selected PTE from modified pages list 
until PTE is: 

- free page PTE 

- valid PTE 

- PSTX in PTE 

- PGFLX in PTE but cluster is full 

*SYSGEN - 
MPW CLUSTER 
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APPENDIX 



LO 



1 

2 

3 

4 

c 
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9 
1C 
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.SBTTL SWAPPER - MAIN LOOP 



FUNCTIONAL DESCRIPTI 
THE MAIN LOOP OF T 
FOR ANY REASON. E 
THEY HAVE ANY ACTI 



ON: 

HE SWAPPER IS EXECUTED WHENEVER THE SWAPPER IS AWAKEN 

ACH OF THE FUNCTIONAL ROUTINES WILL CHECK TO SEE IF 

ON TO PERFORM. 



.PSECT 
OP: 
BSBW 
BSBB 
TSTL 
BEQL 
JSB 

MOVAQ 

SETIPL 

BBSC 

PUSHL 

BS8W 



$: 



BRB 
.DISABL 



$AEX 
BSBB 
MMG$ 
SWAP 
W*EX 
15$ 
EXE$ 
MOVL 
W A SC 
*IPL 
#PCB 
#0 

SCH$ 

SETI 

LOOP 

E LSB 



ENONPA 
BA 
WRTMFY 
SCHED 
E$GL_P 

POWERA 
W A 
H$GQ_H 
$_SYNC 
$V_WAK 

WAITK 
PL #0 



GEO 

LANCE 

PAG 

FATIM 

ST 



NON-PAGED PSECT 
BALANCE FREE PAGE COUNT 
WRITE MODIFIED PAGES 
SCHEDULE SWAP 
CHECK FOR POWER FAIL TIME 
BRANCH IF NO POWERFAIL 
GIVE ANY REQUIREO POWER FAIL ASTS 
SCH$GL_CURPC8,R4 ; GET PROPER PCS ADDRESS 
IBWQ.R2 ; AND ADORESS OF WAIT QUEUE HEADER 
H ; BLOCK SYSTEM EVENTS WHILE CHECKING 

EPEN,PCB$L_STSCRO,20$ : TEST AND CLEAR WAKE PENDING 
; NULL PSL 

; WAIT WITH STACK CLEAN 
; DROP IPL 
; CHECK FOR WORK TO DO 



Example 7-1 Swapper - Main Loop 
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SWAPPING 

MODIFIED PAGE WRITE CLUSTERING 

• Scans PTE's in reverse order from page read clustering 

• Can write clusters to 

page file 
image file 

• If SWPVBN=0 f page going to swap file, no clustering. 

• When building clusters 

cluster size determined by SYSGEN parameter 
MPW_WRTC LUSTER 

scan terminated if 

1. PTE indicates page not on modified page list 

2. PTE points to page in shared memory, or page 
mapped by PFN 

3. PSTX or GSTX doesn't match that of original PTE 

• When writing to page file 

build up several mini-clusters into one larger cluster 

- use one I/O to write larger cluster to disk 

- note that on later page read, mini-clusters may be 
read separately. 
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PROCESS CREATION AND DELETION 

INTRODUCTION 

This module discusses the operations required 

• to create and delete processes under VAX/VMS, and 

• to activate and rundown images within existing processes. 

Process creation and deletion involve several different 
components of VMS. Discussion in this module focuses on the 
process context of each component. Some operations execute in the 
context of the process that requests the particular action, while 
others execute in the context of the target process. 

Image activation and rundown involve construction and removal 
of the data structures and the virtual memory that are defined for 
a specific image rather than for the process. 

Interactive and batch processes involve additional components 
such as command language interpreters (CLIs) , the job controller, 
and possibly the input symbiont process. In addition, interactive 
and batch processes require execution of the LOGINOUT image for 
authorization (only in the case of interactive processes) , and 
also to map the CLI. 

The discussion of the life cycles of processes and images 
should contribute to a better understanding of 

• the implications of multiprogramming application designs, 
and 

• the more fundamental concepts of process and image 
themselves . 
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OBJECTIVES 

Upon completion of this module, you will be able to: 

1. List and explain several differences between user-created 
processes, interactive processes, and batch processes, in 
terms of: 

how the processes are created and deleted 
- how images are activated and exited 

2. Discuss the effects of altering SYSGEN parameters related 
to process creation and deletion, as well as image 
activation. 



RESOURCES 

Reading 



1. VAX/VMS Internals and Data Structures Manual , chapters on 
process creation and deletion, image activation and 
termination, process deletion, and interactive and batch 
jobs. 



Source Modules 

Facility Name 
SYS 



DCL 

MCR 

LOGIN 

JOBCTL 

INPSMB 



Module Name 

SHELL 

PROCSTRT 

SYSCREPRC, SYSDELPRC 

SYSEXIT 

SYSIMGACT, SYSIMGSTA, SYSRUNDWN 

HANDLE, IMAGECTRL, IMAGEXECT, COMMAND 

MCRHANDLE, MCRIMGCTL, MCRIMGEXE, MCRCOMD 
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PROCESS CREATION AND DELETION 

TOPICS 

I. Process Creation and Deletion 

A. Roles of operating system programs 

B. Creation of process data structures 

C. Deletion sequence 
II. Initiating Jobs 

A. Interactive 

B. Batch 

III. DCL Structure and Function 
IV. Image Activation and Rundown 

A. Mapping image file 

B. Image startup 

C. Termination handlers 
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LIFE OF A PROCESS 

Table 8-1 Steps in Process Creation and Deletion 

Action Code 

Creating process SYS$CREPRC 

Inswapped SWAPPER 

Process startup PROCSTRT 

Process deleted SYS$DELPRC 



Table 8-2 Three Contexts Used in Process Creation 

Creator's Swapper's New Process's 
Context Context Context 

$CREPRC From SHELL PC= EXE$PROCSTRT 

• PCB PHD filled in PSL= K mode, IPL=2 

• JIB COMO — > COM Sets up: 

• PQB (temp) SW priority boost - logical names (sys$input . . . ) 

- Catch-all cond . hand. 
Process re- - RMS dispatcher 

turned COMO - Image name moved to PHD 

- Image activated 
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CREATION OF PCB, JIB, AND PQB 



Creator 




$CREPRC 
arguments 



Control 
Region 






Process 
Header 




JIB 

(Pooled 
Quotas) 



New Process 



PCB 



Process 
Quota 
Block 

(PQB) 



Figure 8-1 Creation of PCB, JIB and PQB 

1. $CREPRC allocates from nonpaged pool. 

- PCB 

JIB (if new process is detached) 

- PQB (temporary) 

2. These new data structures are filled from: 

- $CREPRC arguments (e.g., process name) 

- Creator's PCB (e.g., owner PID) 
Creator's control region (e.g., user name) 
Creator's process header (e.g., default privileges) 
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RELATIONSHIPS - PCBs AND JIB 



w 



PID 



10035 



PRCCNT 



OWNER 



JIB 



name 


X 


PID 


10033 


PRCCNT 





OWNER 


10035 


JIB •— 





name 



PID 



10031 



PRCCNT 1 



OWNER 10035 



JIB 



name 



PID 



1002E 



PRCCNT 



OWNER 10031 



JIB 



®. 



JIB for 

all processes 

in this job 

MPID = 10035 

pooled 
quotas 



Figure 8-2 Relationships - PCBs and JIB 
All PCBs point to JIB 

W created X and Y 
O W's PRCCNT is 2 
X and Y owner PID is W PID 

Y created Z 

No pointers from creator to subprocess 
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PCB VECTOR 



::sch$gl_pcbvec 




PCB 

of 

PRTSYMB1 



PCB 

of 

OPCOM 



Figure 8-3 PCB Vector 



On process creation, search for unused vector 

Unused vectors point to Null's PCB 

Table of pointers to all PCBs 

Index into table is PID 

SCH$GL PCBVEC points to start of table 



*SYSGEN 

MAXPROCESSCNT 

Maximum number of processes allowed on the system. 
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PID AND PCB, SEQUENCE VECTORS 



NULL 



SWAPPER 




RFMT 



OPCOM 



JOB CONTROL 



to PCB of 
new process 



1 



* 



INDEX 



New Sequent 



:: SCH$GL_PCBVEC 



::SCH$GL_SEQVEC 



^ 



Old seq. no. 




Process ID 

Figure 8-4 PID and PCB, Sequence Vectors 



• PID contains two parts: 

- Index (into PCB vector and sequence vector) 

- Count (sequence number) 

• PID formed at process creation. 

• Old sequence number + 1 = new sequence number. 

• SCH$GL SEQVEC points to start of sequence vector 
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SWAPPER'S ROLE IN PROCESS CREATION 




Slot # 


VBN 



WSSWP 



PCB 

Figure 8-5 Swapper's Role in Process Creation 



• For new process, WSSWP is negative 

• Negative WSSWP — > SHELL copied 

• Swapper 

Stores SYSGEN parameters in PHD 
Initializes pointers, counters in PHD 
Initializes system page table entries 
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PROCSTRT'S ROLE IN PROCESS CREATION 



New Process 




Control 
Region 






Process 
Header 



Figure 8-6 PROCSTRT's Role in Process Creation 

Hardware PCB defined in SHELL 

PC and IPL invoke PROCSTRT at IPL 2 

Code located in SYS. EXE 

Functions 

- PQB — > PHD and PI 

- Change to user mode, IPL 

- Call SYS$IMGACT 

Call image at transfer vector 
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AFTER PROCESS CREATION, IMAGE RUNS AND EXITS 

Table 8-3 Steps in Process Creation and Deletion 
Action Code 

Creating process SYS$CREPRC 

Inswapped SWAPPER 

Process startup PROCSTRT 

Process deleted SYS$DELPRC 
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PROCESS CREATION AND DELETION 

INTRODUCTION - PROCESS DELETION 

• All traces of process removed from system. 

• All system resources returned. 

• Accounting information passed to job controller. 

• For subprocess, all quotas and limits returned to creator 

• Creator notified of deletion. 
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PROCESS DELETION 



name 


BERT 


PID 


10033 




PRCCNT 







OWNER 


10035 





name 


OTG 


PID 


10035 




PRCCNT 


2 




OWNER 








name 


ERNIE 


PID 


10031 




PRCCNT 







OWNER 


10035 





Figure 8-7 Process Deletion 

• Deleted by special KAST while CURRENT. 

• Sequence 

$DELPRC (subprocesss) 

Accounting information to job controller 

- Call SYS$RUNDOWN 
Delete PI space 

- Free PCBVEC and SWAP slots, page file space 

- Decrement counts 

Balance set 
Total processes 

- Jump to SCH$SCHED 
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PROCESS TYPES AND CREATORS 

Table 8-4 Process Types and Creators 

Process Type Code Created By 

Interactive $CREPRC Job Controller 

Batch $CREPRC Job Controller 

Subprocess $CREPRC= Owner 

$RUN 
$ SPAWN (DCL) 

Detached $CREPRC Owner 

$RUN (DCL) 

Note: RUN and SPAWN call $CREPRC 

After system initialization 

A process is created by another process 
Process creation is done by $CREPRC 



301 



PROCESS CREATION AND DELETION 



DCL BASED PROCESSES 

• Image run is LOGINOUT.EXE 

• LOGINOUT functions: 

- Interactive 

prompts for username, password 
checks SYSUAF.DAT 

- Batch 

no prompting 

Alters process characteristics to match UAF record 
privileges 
quotas 

- Activates login command procedure 
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INITIATING INTERACTIVE JOB 



Terminal 
Driver 




SYSSINPUT 
SYSSOUTPUT 
SYSSERROR 
SYSSCOMMAND 



Job 
Controller 



J Creates I 
Process I 



Context of Job 
Controller Process 



Context of Newly 
Created Process 



LOGINOUT.EXE 
1) Verify Username/Password 





2) Alter process characteristics 
Set up process permanent files 



3) Map requested CLI into 
PI Space and pass 
control to CLI in 
supervisor mode 




Figure 8-8 Initiating Interactive Job 



• Job controller notified by driver 

• Job controller creates process _TTcu; 

• LOGINOUT runs 

• DCL, MCR mapped 
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INITIATING JOB USING $SUBMIT 




SYSSOUTPUT 
SYSSERROR 




1) No username/password 
verification 

2) SYSSINPUT and SYSSOUTPUT 
are different 



BATCH.LOG 




Figure 8-9 Initiating Job Using $SUBMIT 



• Similar to interactive process but - 

- Job controller notified by DCL ($SUBMIT) 

User already validated 

Files are assigned: 

SYS$INPUT to batch stream 
SYS$OUTPUT to log file 
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INITIATING JOB THROUGH CARD READER 




SYSSCOMMAND 



t±3=> 



SYSJOUTPUT 
SYSSjERROR 



LOGINOUTEXE 



1) No us«rnam« password 
verification 



21 SVSSINPUT and SYSSOUTPUT 
an di If* rant 



Figure 8-10 Initiating Job Through Card Reader 

Q Job controller notified by card reader driver 

A Job controller creates input symbiont process 

- user authorization 

read cards into command file 
submit as batch job 

Same as for $SUBMIT 
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DCL OPERATION 



DEBUG Command 

Generate 

SSS.DEBUG 

signal 



CLI Initialization 
Code 



STOP Command 



EXIT Command 



I 



from LOGINOUT 



Beginning of CLI 
Command 
Processing Loop 



External 
klmage 



CONTINUE 
Command 



Service internal 
commands 

If CONTINUE. STOP. 
EXIT. DEBUG, go there. 



<CTRL-Y> AST 



transfer-address 



RET 



Portion of CLI that 
activates and calls 
external images 



I CALL image 
CALLSYS$EXIT< 



$EXIT 

System 
Service 



Supervisor Mode 
Termination Handler 
Declared by CLI 




Image Code 

Figure 8-11 DCL Operation 

Glorified exit handler 
Main command loop 

prompts for command 

uses DCL tabes to decide 
image 

internal routine 
Command code 

image, runs in P0 space 

internal routine, runs in PI space 
Control-Y AST 
$EXIT (image) 
LOGOUT (LOGINOUT.EXE) 
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STEPS IN IMAGE ACTIVATION AND TERMINATION 

Table 8-5 Steps in Image Activation and Termination 
Action Code 

1. Image activation SYS$IMGACT 

2. Image startup SYS$IMGSTA 

3. Image executes 

4. Image exit SYS$EXIT 
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IMAGE ACTIVATION 

SYS$IMGACT: 

- System service, executive mode 

- Called by DCL, INSTALL 
Sequence 

• Open image file 

• Read image header 

• Map image 
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IMAGE FILE MAPPED TO VIRTUAL ADDRESS SPACE 



Object 
File(s) 




,^^^^, Linker 




Image Header 

Image Section 
Descriptors 


Executable 
File 


Image 




^^Bj Image 
'^^Hr Activator 


Fixed Portion 




WSL 

t 
PST 


Process 
Header 


POPT 
P1PT 





Figure 8-12 Image File Mapped to Virtual Address Space 
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PROCESS CREATION AND DELETION 



Image Header 



Image Itself 



Debug and 
Other Symbol 
Tables 



Fixup Vector 



Image File 



* ® 



© 
® 



N © 

\ 



\® 



Fixed Portion of 
Image Header 



Transfer Address 
Array 



Debug and Global 
Symbol Table Offsets 



Image Name and 
IDENT Strings 



Patch Data 



Image Section 
sy Descriptors 



Offset to® 


Size of Header 


Offset to© 


Offset to© 


Spare 


Offset to(E) 


minor ID 


major ID 


Spare 


image 
type 


Header 
Blocks 


Requested 
Privilege Mask 


Image I/O 
Seg. Pages 


I/O 
Channels 


Image Flags 


Global Section ID 


System Version Number 



Image Header 



Fixed Portion of 
Image Header 



Figure 8-13 Image Header 



Image file contains 

Image header 
Image 
- Symbol tables 
Fixup vector 
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IMAGE SECTION DESCRIPTOR 



end of demand 

zero section descriptor 



end of global 
section descriptor 



end of process 

private section descriptor ^ 



number of pages 
in this section 



page fault 
cluster 



type 



o« 

253" 



► normal 

► user stack 



size of ISD 



starting virtual page 
number for this section 



section flags 



base virtual block number 
in image file for this section 



ident for global section 



count 



global section name 



Image Section Flags 
Bit Meaning 

Global 

1 Copy on Reference 

2 Demand Zero 

3 Writeable 

4-6 Match Control Field 

7 Last Cluster in PO 
Space 

8 Copy Always from 
Image File 

9-16 Spare 

17 Vector Contained 
in Image Section 

18 Image Section 
is Protected 



Figure 8-14 Image Section Descriptor 



Image section descriptors for 

Demand zero sections 
Process private sections 
Global sections 
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KNOWN FILE ENTRY, HEADER 



Known File Entry (KFI) 



Known File Header (KFH) 



Known File Queue Forward Link 



Known File Link Backward Link 



Control 
Bits 



Type 



Pointer to WCB 

File ID/Sequence Number 



Image Header Address 
if Header Resident 



Privileged Image 
Privilege Mask 



Global Section Identification 



Ok 



Device Name. Directory. 
File Name. File Type 



Address ol Associated KFI 



Type 



Image Header of Known 
File that was installed 
header-resident 



One of these in Paged 
Pool for each known tile 
installed/HEADER RESIDENT 






One of these for each 
installed image 



Figure 8-15 Known File Entry, Header 



• Image file marked as known in image header 

• Known file lists searched 

• Created by INSTALL utility 



*SYSGEN 



KFILSTCNT 



# 
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IMAGE START UP 



SYSSIMGSTA 


Transfer address 
user image 


of 









1 



SYSSIMGSTA 



LIBSINITIALIZE 



Transfer address of 
user image 



SLINK 

or 

SLINK/DEBUG 

or 

SLINK/DEBUG = filespec 



Transfer address of 
user image 



LIBSINITIALIZE 



Transfer address of 
user image 



$LINK/NOTRACEBACK 



no entries in PSECT 
LIBSINITIALIZE 



non-zero contribution to 
PSECT LIBSINITIALIZE 



Figure 8-16 Image Startup 



• SYSSIMGSTA 

- Functions 

Purge working set 
Map debugger 

Establish traceback handler 

Alter argument list - point to next transfer 

vector address 

- LIBSINITIALIZE 

Transfer address obtained from image header. 
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EXIT SYSTEM SERVICE 




YES 



YES 



YES 



REITO 

CORRESPONDING 

MODE 



CALL 

CORRESPONDING 
HANDLERS LIFO 



C 



CALLSEXIT 



3 



TK-8970 



Figure 8-17 Exit System Service 
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TERMINATION HANDLERS 





' 





-J 




4 








::CTL$GL_THEXEC 








*k 






(exec) 

E 
(first) 


(exec) 

F 

(second) 








::CTL$GL_THSUPR 




4 



















































(super) 
D 


* 

s 
* 
* 

* 










* 
* 


forward link 






exit handler address 















N 

















\ 




V 




address in which to store 
reason for exit 




(user) 

A 
(first) 


(user) 

B 

(second) 


(user) 

C 
(third) 


$ 




. additional arguments X> 
(if any) T 



Figure 8-18 Termination Handlers 



Mode 



Table 8-6 How Termination Handlers Are Set Up For 
Different Access Modes 

Set Up By 



User 

Supervisor 

Executive 



User image 

DCL 

PROCSTRT for RMS rundown 



Exit in kernel mode causes process deletion. 
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AND SHUTDOWN 




SYSTEM INITIALIZATION AND SHUTDOWN 



INTRODUCTION 

The study of the initialization of a VAX/VMS system provides 
a convenient summary of many of the topics previously discussed in 
this course. It is during initialization that the structures, 
mechanisms, and other features of the VMS environment are 
established. 

Each component of the initialization sequence is discussed 
from turning on the power to the final startup command procedure 
and the enabling of logins. Included is an explanation of: 

• why each component executes in its particular environment, 
and 

• why it executes at its position in the overall 
initialization sequence. 

In addition, some time is spent discussing the shutdown and 
recovery sequences involved in power failure and bugcheck. 



OBJECTIVES 

Upon completion of this module, you will be able to describe, 
in general terms the sequence of operations involved in: 

1. initial bootstrap 

2. powerfail and recovery 

3. bugcheck and reinitialization 

Differences between 780/750/730 

Discuss the effects of altering SYSGEN parameters relating to 
system initialization. 
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RESOURCES 

Reading 

1. VAX/VMS Internals and Data Structures Manual , chapters on 
error handling , bootstrap procedures, operating system 
initialization, and powerfail recovery. 



Source Modules 

Facility Name 

BOOTS 

SYS 



SYSINI 

Hardware Microfiche 



Module Name 

SYSBOOT, SYSGEN 

VMB 

INIT 

INILOA 

SYSPARAM 

POWERFAIL 

BUGCHECK, BUGCHKMSG 

SYSINIT 

CONSOLE. SYS 
Memory ROM program 
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TOPICS 

I. Initialization 

A. System initialization sequence 

B. Functions of initialization programs 

C. How memory is structured and loaded 

D. Startup command procedures 

E. SYSBOOT, SYSGEN 

F. 780, 750, 730 hardware differences and how they affect 
initialization 

II. Shutdown and Restart 

A. Front panel switches 

B. Shutdown procedures and their functions 

C. Autorestart sequence 

D. Power-fail recovery 
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SYSTEM INITIALIZATION AND SHUTDOWN 

VAX-1 1/780, 11/750, 1 1 /730 CONSOLE DIFFERENCES 

780 and 730 

contain a console microprocessor 

780 - LSI11 
730 - 8085 

boot/restart information available on console media 

780 - floppy 
730 - TU58 

750 

no console microprocessor 

boot/restart information in ROM (normally) or on disk 
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SYSTEM INITIALIZATION 




TEST 



LOAD INITIAL 
PROGRAM 



OBTAIN SYSTEM 
PARAMETERS 



LOAD OPERATING 
SYSTEM 



RUN INITIALIZATION 
CODE 



ACTIVATE STANDARD 
COMMAND PROCEDURE 



ACTIVATE SITE'S 
COMMAND PROCEDURE 




Figure 9-1 System Initialization 
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SYSTEM INITIALIZATION SEQUENCE 



11/750 

I 
CONSOLE PROGRAM 

® DEVICE SPECIFIC 
INFORMATION 



v 

VMB.EXE 
SYSBOOT.EXE 

SYS.EXE 

I 
SYSINIT.EXE 

* 
STARTUP.COM 

I 
SYSTARTUP.COM 



11/780, 11/730 

♦ 

MICROPROCESSOR 

STARTS UP 

I 

BOOT BLOCK 

PROGRAM 
I 
CONSOL.SYS 
I 



® 



Figure 9-2 System Initialization Sequence 



o 
o 
o 



Bootstrap computer using ROMs in CPU. 

Bootstrap computer using LSI-11 (780) or 8085 (730) 

Finish system initialization 

Finish preparing system 

Load operating system 

Run operating system initialization code 

Activate VMS standard and site specific DCL procedures 
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INITIALIZATION PROGRAMS 



Table 9-1 Initialization Programs 



Program 



Function 



CONSOLE. SYS Loads VAX writeable diagnostic control store 
(CONSOLE.EXE Acts as monitor for console terminal commands 
on 730) On boot command loads, passes control to 
VMB.EXE 



Environment 



LSI (780) 
8085 (730) 
CPU (750) 



VMB.EXE 



Sizes physical memory, discovers external 

adapters 
Sets up primitive SCB 
Locates, loads, and passes control to 

SYSBOOT.EXE 



VAX memory 
Physical 
address 



SYSBOOT.EXE 



Loads SYSBOOT parameters 

Sizes system space, sets up system page table 

Locates and loads SYS. EXE 

Sets up full SCB 

Maps nonpaged pool into high end of physical 

memory 
Sets up P0 page table 
Passes control to INIT in SYS. EXE 



VAX memory 
Physical 
address 



INIT 

(in SYS. EXE) 



Turns on memory management 
Maps and initializes the I/O adapter 
Maps paged pool 

Loads terminal driver and system disk driver 
Initializes several scheduling and memory 
management data structures 
Invokes SCHED.MAR 



VAX memory 
Physcial 

address/ 
Virtual 

address 



SYSINIT 



Opens and stores locations of page files, 
files, swap files, and dump file 

Maps RMS and system message file as system 
sections 

Creates disk ACP process 



Process 
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Table 9-1 Initialization Programs (Cont) 



Program 



Function 



Environment 



STARTUP.COM 



Creates several system logical names 
Creates job controller, error log formatter, 

OPCOM processes 
Invokes INSTALL 

Invokes SYSGEN for autoconf igure 
Invokes RMSSHARE 
Invokes SYSTARTUP.COM 



Process 



SYSTARTUP.COM Site specific, such as: 

• Create logical names 

• Load user written device drivers 

• Install privileged and shareable images 

• Set up queues and terminal characteristics 



Process 



327 



SYSTEM INITIALIZATION AND SHUTDOWN 



PHYSICAL MEMORY DURING INITIALIZATION 



ON ENTRY TO VMB.EXE 



Restart Parameter 
Block (RPB) 



Primary 

Bootstrap 

Program 

VMB 



«— SP 



ON ENTRY TO SYSBOOT.EXE 



Restart Parameter 
Block (RPB) 



Primary 

Bootstrap 

Program 

VMB 



System Control Block (SCB) 
for VMB 



PFN Bitmap 



Bootstrap Stack 



Secondary 

Bootstrap 

Program 

SYSBOOT 



«— RPB$L.BASE 
+^X200 



«-PR$_SCBB 



«— SP 



Figure 9-3 Physical Memory During Initialization 



• Console or ROM programs have located 64K bytes of good 
contiguous memory. 

• On entry to VMB.EXE 

Console program has loaded VMB into the known good memory, 
leaving 512 bytes for the Restart Parameter Block. 

• On entry to SYSBOOT.EXE 

VMB has loaded 

Restart Parameter Block with values from R0-R5 
System Control Block with vectors pointing to one 
routine 

PFN Bitmap with map of error free pages in physical 
memory 
- SYSBOOT.EXE 

VMB has also allocated Bootstrap Stack, used by VMB and 
SYSBOOT 
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PHYSICAL MEMORY LAYOUT AFTER SYSBOOT ENDS 



Dynamic Pages 



PFN Database 



Nonpaged Executive 
Code and Data 



Nonpaged Dynamic Memory 



Interrupt Stack 



System Control Block 



System Header 



System Page Table 



4— MMG$GI MAXPFN 

(Physical Page Number) 



4—0 



4— PR$_SCBB 

(Physical Address) 



4— PR$_SBR 



(Physical Address) 
-Largest PFN 



Figure 9-4 Physical Memory After SYSBOOT Ends 



SYSBOOT has 



• Sized the pieces of memory shown above 

• Filled in the SCB and part of the system header 

• Mapped and read in SYS. EXE (Executive code) 
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TURNING ON MEMORY MANAGEMENT 



PO 
Region 



® 



Virtual Address Space 



From SYSBOOT 



EXESINIT:: 

MOVL RPB$L_BOOTR5(R11).FP 
MTPR #1.S A #MAPEN 



JMP <&>#10$ 



10$: 



MOVL EXE$GL_INTSTK.SP 







System 
Space 



EXESINIT:: 

MOVL RPB$L_B0OTR5(R11),FP 
MTPR #1.S A #MAPEN 
JMP (©#10$ 



10$: 
MOVL EXE$GI INTSTK.SP 



Physical Address Space 



EXE$INIT:: 

MOVL RPB$I BOOTR5(R11),FP 

_MTPR #1.S A #PR$_MAPEN (?) 



JMP (5>#10$ 



10$: 



MOVL EXE$GL_INTSTK,SP 



Figure 9-5 Turning on Memory Management 

Done by INIT in SYS. EXE 
Physical to virtual transition: 

Q - All address references treated as physical addresses 

- INIT page table entries set up so P0 virtual address 

equals physical address 

- S0 and P0 page table entries for INIT contain same 
PFNs 

Q Writing a ' 1* to processor register MAPEN causes 
following address references to be treated as virtual 
addresses 

O Next instruction is found in P0 space 

Q When INIT was linked, base was in S0 space, so JMP 
@#10$ causes jump to address in S0 space 
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SYSINIT 



• Created by swapper as part of one-time initialization 
routine . 

• Selected from COM queue after SWAPPER goes into normal 
HIB. 

• Major functions 

Open and record locations of page, swap and dump files 

- Map RMS and system message files 
Mount system disk, creating disk ACP 

- Create STARTUP process 
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STARTUP 
Startup Process 

- Runs as final part of initialization 

- Runs using DCL command procedures 

STARTUP.COM 
SYSTARTUP.COM 

STARTUP.COM 

- Assigns logical names 
Creates system processes 

ERRFMT 

J0B_C0NTR0L 

OPCOM 
Installs VMS images 
Autoconf igures all devices 

SYSTARTUP.COM 

- Mounts volumes other than the system disk 

- Assigns site specific logical names 
Sets up site specific 

Terminal characteristics 

Print and batch queues 
Installs site specific images 
Starts DECnet 
Loads user written device drivers 
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SYSBOOT AND SYSTEM PARAMETERS 



mplied USE CURRENT 



Default 

Parameter 

Settings 

Internal 

to 

SYSBOOT 




USE 
DEFAULT 



USE filespec 




SYSBOOT 

Table 

of 

Working 

Values 




Parameter 
Settings 

in Memory 
Image of 

Executive 




© 
USE 
SET 
CONTINUE (EXIT) 



Figure 9-6 SYSBOOT and System Parameters 



SYSBOOT: 






Brings in current parameters 

Allows changes if conversational boot requested 

Writes parameters to loaded SYS. EXE 

Runs as part of system initialization 

Can alter all parameters used in present system 

Cannot create alternate parameter files 
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SYSGEN AND SYSTEM PARAMETERS 



USE 
DEFAULT 



Default 

Parameter 

Settings 

Internal 

to 
SYSGEN 



Parameter 
Settings 
in Memory 
Emage of 
Executive 




WRITE 
CURRENT 



WRITE 
ACTIVE 



Parameter 
Settings 

in Memory 
Image of 

Executive 



SYSGEN: 



Figure 9-7 SYSGEN and System Parameters 






Runs as an editor-like utility under VMS 

Can alter dynamic parameters on present system 

Can create alternate parameter files 

Can alter parameters used on next system initialization 
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VAX- 1 1 /780 PROCESSOR 



INDICATES 
OPTIONAL 
EQUIPMENT 









FPA 


ucs 




FLOPPY 
DISK 




SYSTEMS 
CONSOLE 


VAX-1 1/780 
CPU 










MEMORY 
CONTROLLER 


MEMORY 
CONTROLLER 


MULTIPORT 
MEMORY 


MULTIPORT 
MEMORY 


LA 120 








REMOTE 
DIAGNOSIS 


MEMORY 






CACHE 


7 


I/O ADAPTORS 




■Ilk 

UNIBUSL- 


■Ilk 

MASSBUSr 


■ 

DR780 



w 



1 STANDARD 
3 OPTIONAL 



¥ 



4 OPTIONAL 



♦ 



1 OPTIONAL 



Figure 9-8 VAX-11/780 Processor 



Program on ROM causes CONSOLE. SYS to be loaded from floppy 
into LSI-11 memory 

CONSOLE. SYS runs on LSI-11 

loads diagnostic control store 

cause ROM in memory controller to find 64K good bytes 

loads VMB.EXE from floppy disk to VAX memory 
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VAX-1 1/750 PROCESSOR 



TU58 



LA 120 







UCS 




SYSTEMS 
CONSOLE 


VAX-1 1/750 
CPU 




MEMORY 
CONTROLLER 


REMOTE 
DIAGNOSIS 


MEMORY 


L 


CACHE 


7 


I/O ADAPTORS 



UNIBUS 



MASSBUS. 



# V 



F 



1 STANDARD 



3 OPTIONAL 



LZZ] 

INDICATES 
OPTIONAL 
EQUIPMENT 



Figure 9-9 VAX-11/750 Processor 
console program stored in ROM with CPU 

locates 64K good bytes 

passes control to device ROM 
device ROM 

reads boot block from device 
boot block program 

loads VMB.EXE from specified system device 
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VAX-1 1 /730 PROCESSOR 























4-RL02S 




Dual TU58s 




FPA 


IDC 


^^^^T 3-RL02S 
















Console 
Subsystem 


Data Path 


& 1-R80 


RD 




















/ 








Control Store 




7 


LA 120 












Memory Controller/ 
Input/Output 














UNIBUS 










COMBO 
Board 

















Figure 9-10 VAX-11/730 Processor 



□ Optional 



Program on ROM causes CONSOLE.EXE to be loaded from TU58 
into 8085 memory 

CONSOLE.EXE runs on 8085 

loads microcode into CPU from TU58 

executes DEFBOO - loads registers of CPU, finds 64K 
good bytes 

loads VMB.EXE from TU58 
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VAX FRONT PANELS 



KEY SWITCH 




AUTO 
RESTART 





OFF 
ON 





BOOT 



ATTN RUN POWER REMOTE 

5 5 5 5 



LOCAL 



REMOTE 



VAX 11/780 Front Panel 



CPU STATE 



POWER RUN ERROR INITIALIZE 

o o o o 



BOOT DEVICE 

A 

B 

C 

D 



— i BOOT I — 1 

f^i RESTART-/' \ 

-U halt < — u 

-J RESTART -J 



POWER ON ACTION 
BOOTT 
RESTART- 
HALT | 
RESTART- 



KEY SWITCH 



LOCAL 



SECURE 



OFF 






REMOTE/ 
SECURE 



REMOTE 



VAX 11/750 Front Panel 



r RUN DC ON BATT R/D 

o o o o 

AUTO RESTART BOOT 



OFF 



ON 



^a 



LOCAL \ / LOC DSBL 

^REM DSBL 



STDBY 



OFF 



-e 



REMOTE 



VAX 1 1/730 FRONT PANEL 

Figure 9-11 VAX Front Panels 
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SYSTEM INITIALIZATION AND SHUTDOWN 



Table 9-2 Switches on 780, 730/ 750 



11/780 



11/750 



OFF OFF 

LOCAL/DISABLE SECURE 



LOCAL 



LOCAL 



REMOTE 



REMOTE 



11/730 



Effects on Console 
Terminal and System 



STANDBY 
LOCAL/DISABLE 

LOCAL 



REMOTE 



REMOTE/DISABLE REMOTE/SECURE REMOTE/DISABLE 



OFF 



Power partially off 

Local terminal-program 
I/O mode only. Remote 
disabled. 

Local terminal-program 
I/O mode and console 
I/O mode. Remote dis- 
abled. 

Local terminal disabled, 
Remote-console I/O 
mode and program I/O 
mode . 

Local terminal disabled, 
Remote-program I/O 
mode only. 

Power completely off 



339 



SYSTEM INITIALIZATION AND SHUTDOWN 

SHUTDOWN OPERATIONS 

Table 9-3 Shutdown Operations 

Action Operation 

Clean shutdown $ @SYS$SYSROOT: [SYSEXE] SHUTDOWN 

Quick shutdown $ RUN SYS$SYSTEM: OPCCRASH 

Forced crash Control/P (on OPA0:) 

>>>@CRASH (780/730 only) 

>>>E P (750 only) 

>>>E/G F 

>>>E/I 

>>>E/I 1 

>>>E/I 2 

>>>E/I 3 

>>>E/I 4 

>>>D/G F FFFFFFFF 

»>D P 001F0000 

>>>C 

Halt system Control/P (on OPA0:) 

>>>H (780/730 only) 
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SYSTEM INITIALIZATION AND SHUTDOWN 



SHUTDOWN PROCEDURES 



Table 9-4 Shutdown Procedures 



Procedure 



Function 



SHUTD0WN.COM 



Warns users of shutdown 

Stops queues 

Removes installed images 

Stops processes 

Runs OPCCRASH 



OPCCRASH 



Marks system disk for dismount (to force 

cache flushing) 

Flushes modified page list 

Requests "operator" BUGCHECK 



CRASH.CMD 



Halts CPU 

Examines PSL and all SPs 

Deposits -1 in PC 

1F000 in PSL 
Continues 
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SYSTEM INITIALIZATION AND SHUTDOWN 



AUTORESTARTING THE SYSTEM 




TURN MEM. MANAGE- 
MENT ON 



NO 



<: 



REBOOT VMS 



3 



RESTORE INTERRUPT 
STACK 



CALCULATE NEW 
SYSTEM TIME 



SCAN TIMER QUEUE 



MAKE ERROR LOG 
ENTRY 



INITIALIZE 
ADAPTERS 



NOTIFY DEVICE 
DRIVERS OF POWER 
FAIL 



RESTORE REGISTERS 



c 



REI 



J 



Figure 9-12 Autorestarting the System 
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SYSTEM INITIALIZATION AND SHUTDOWN 

REQUIREMENTS FOR RECOVERY AFTER POWER-FAIL 

• Battery backup 

• Memory Valid (battery not run down) 

• RPB & Memory valid and warm restart flag c-leared 

• VAX-11/780 - Autorestart On 

- RESTART.CMD on console floppy 

- RESTART.CMD contains right TR 
number for system disk adapter 

• VAX-11/750 - Power action SW on 'Restart/Boot' or 
'Restart/Halt' 

• VAX-11/730 - Enable Restart 
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APPENDIX 



VAX- 11/782 
Definitions 

Loosely Coupled: 

Tightly Coupled: 
Symmetric : 
Assymmetric: 
Primary Processor 
Secondary Processor: 



Each processor executes a separate copy of the 
operating system. This is good for 
high-availability. 



Both processors share the same copy of the 
operating system. 



All processors execute all the operating 
system code . 



All processors cannot execute all the 
operating system code. 



The CPU that executes Kernel-mode code as well 
as Executive, Supervisor, and User. 



The CPU that cannot execute Kernel-mode code. 
It executes Executive, Supervisor, and User 
mode code. 

The VAX-11/782 is a tightly-coupled multi-processing system 
that is assymmetric for kernel-mode and symmetric for the other 
modes . 
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PROCESSOR 
A 




PROCESSOR 
B 

Secondary 



TK-9021 

Figure 9-13 Sample VAX-11/782 Configuration 

Two VAX-11/780S connected to the same shared memory. 

The primary (on the left) has the I/O devices. The 
secondary or attached processor (on the right) has just 
the CPU. 

Minimum local physical memory (256Kb) on each CPU for 
diagnostics only. 

All information in the shared memory. 

Eight Meg maximum physical memory for the shared memory. 

Primary Processor runs all interrupt and Kernel-mode code. 
Both processors run Executive, supervisor, and user mode 
code . 

Multi-processing code takes approximately 8K bytes (16 
pages) in non-paged pool. 
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1. Initialization 

a. Start primary processor. 

The DEFBOO.CMD file used to boot the primary processor 
"request" that the MA780 memory be used instead of the 
local physical memory. The memory on MA780 #1 starts 
at physical address 0. 

b. After the normal system is booted, a privileged 
program (MP. EXE) is run in the site-specific command 
file. MP. EXE is activated by the START/CPU DCL 
command. MP. EXE does the following: 

Allocates nonpaged pool and loads in the MP code. 

- Connects the 'hooks' into the VMS code (discussed 
later) . 

- New SCB initialized for the secondary CPU. 

- Primary SCB slightly modified to handle 

• scheduling code for secondary processor 

• MA780 interrupt communication 

c. Start Secondary processor. Accomplished by booting 
with an abbreviated command file in CSA1. This 
results in: 

initialization of memory configuration 
start executing at address in RPB. 
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2. Hooks into VMS 

Naming Conventions 
• MPH$samename 



indicates a routine that will be entirely replaced by 
a MP routine of the same name. 

MPH$newnameHK 

indicates a location of a hook to additional MP code 
(instead of a replacement) . 

MPH$newnameCONT 

indicates a location where additional MP code will 
return to normal flow of code. 

Locations of Hoods (Executive Module Names) 

• ASTDEL AST delivery and queueing 

• BUGCHECK BUGCHECK for both processors 

• PAGEFAULT Translation buffer invalidations 

• SCHED Process scheduling and rescheduling 



3. SCB changes 
• CPU2 



New SCB created for the secondary processor in 
nonpaged pool. This SCB points to different routines 
than those used by the primary CPU. 

CPU1 

- MA780 vectors redirected to point to new MP 
primary CPU interrupt routine. 

IPL=5 SCB interrupt vector now contains address of 
MP secondary scheduling routine. 

- XDELTA interrupt is moved from IPL=5 to IPL=F. 
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4. Secondary Processor States 

P 



<STOP>< 



<INIT>«*- 



<ID 



LE>« 



•<DROP> 



<EXEC> 

S 
■<BUSY> 



P = PRIMARY MAKES TRANSITION 
S = SECONDARY MAKES TRANSITION 



TK-9013 



Figure 9-14 Secondary Processor States 

The current state of the secondary processor is recorded 
in the state variable in nonpaged pool. The contents of 
this variable (the state) is used to by the primary 
processor to determine whether to schedule word for the 
secondary processor or not. 



<INIT> 

I 

v 
<IDLE> 

I 

v 
<BUSY> 



Processor state when MP. EXE runs. 
After MP. EXE (initialization code runs) 
when a process is found for CPU2 



<EXECUTE> After a LDPCTX instruction is issued 



v 
<DROP> 



I 

v 
<IDLE> 

<STOP> 



At quantum end or kernel mode request 
by CPU2, a SVPCTX issued, the state 
changed to DROP, interrupt primary. 



After CPU1 takes back process 

Requested by system manager ($STOP/CPU) 
requested by CPU1 
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If there is not process for CPU2 to run, an AST is used to 
indicate when a process falls below the kernel mode level. 
The AST delivery is turned into a rescheduling interrupt. 

5. Exceptions for CPU2 

If there is a transition to Kernel mode: 

A SVPCTX is issued 

Process is "handed" to CPU1 

AST Delivery and quantum End both execute have special 
code. 

A separate SCB for the secondary processor allows the 
enforcement of the rules. 

6. MA780 

Has the ability to interrupt either processor. 
Reasons for CPU1 to interrupt CPU2 

1. To request an invalidation of a System Virtual 
Address . 

2. AST has arrived for process on CPU2 

3. BUGCHECK 

Reasons for CPU2 to interrupt CPU1 

1. To request rescheduling 

2. Log an error 

3. Request a BUGCHECK 
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7. Faults 

• POWERFAIL 

If CPU2 goes, CPU1 continues 
If CPU1 goes, CPU2 waits 

• BUGCHECK 

If a BUGCHECK occurs, CPU2 goes IDLE while CPU1 writes 
the sysdump file and reboots. 

• MACHINE CHECK 
Like normal VMS 

8. Restrictions 

The processors must be "twins" (ECO,WCS level, FPA) 
First MA780 must be at physical address 

- Same TR # for the MA780S on both CPUs 

- No DR780 

- No high speed RP07s (2.2mb), 1.3mb allowed 



NOTE 

Before MP. EXE runs, the RPB contains a 

self-jump loop. After MP. EXE runs, RPB 

contains the address of the secondary CPU 

startup code. In this way the secondary CPU 

(CPU2) can be started before the primary CPU 
(CPU!) is finished booting. 
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—Page Boundary — 

MPS$GL_ISP 

MPS$GL_SCBB 

MPS$GL_STRTVA 

MPS$GL_MPMBASE 

MPS$GL_CURPCB 

MPS$GL STATE 



(Relocated initial ISP address) 
(Physical address of attached's SCB) 
(SVA of starting instruction address) 
(SVA of shared memory controller regs) 
(Attached's current process PCB addr) 
(Attached processor's state) 

other header page data 



-Page Boundary 

(Attached's SCB) 



pointers to code below 



vector 44 (CHME) 
vector 48 (CHMS) 
vector 4C (CHMU) 



pointers to code below 



— Page Boundary 

MPS$AL INTSTK (1024 byte interrupt stack for attached) 

CODE 
CODE 
CODE 



-EXE$GL M 



SCB$AL E 



(EXE$CMODEXE 
(EXE$CMODSUE 
(EXE$CMODUSE 



See next pag 



Figure 9-15 MP. EXE Loaded into Nonpaged Pool 
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CODE Section from diagram on previous page contains: 

1. Addresses being pointed to by almost all of the SCB 
vectors 

2. System locations that are jumped to as a result of being 
modified by the MP. EXE code. See Table 9-5. 



Table 9-5 System Locations and the Resulting MP Locations 



System Locations 



MP Locations 



SCH$SCHED 

SCH$RESCHED 

MPH$QAST 

MMG$ INVALIDATE 

MPH$BUGCHKH 

MPH$ASTDELHK 

MPH$NEWLVLHK 



SCH$MSCHED 

SCH$MRESCHED 

MPS$QAST 

MPS$INVALID 

MPS$BUGVHECK 

MPS$ASTSCHEDCHK 

MPS$ASTNEWLVL 
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